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FINNISH DATA 


As this book was going to press, it was discovered! that, for various 
reasons, the student scores in Finland’s Populations 1a and 1b were 
incorrectly weighted and the means and standard deviations for these 
populations were therefore incorrect. However, it has been possible 


to calculate unweighted scores which, in ‘this case, give reasonable 
estimates for Finland. These are as follows: 


Population 1a Population 1 b 
Mean 15.39 16.13 
S.D. 10.76 11.61 
N. 1156 1325 


The unweighted standard deviation of age for Population 1b is 
6.7. In nearly all analyses in this book Finnish unweighted scores 
have been used. Where it has not been possible to rerun the analysis 
with the unweighted scores, this is mentioned. 


+ See Volume II of Husén et al. (1967). 
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CHAPTER I 


Frame of Reference 


Comparative education as a discipline is concerned with the study 
of cross-national or cross-cultural variability in the domain of edu- 
cation. Until the beginning of the 1950's it consisted mainly of 
separate descriptions of various systems of education; many of the 
comparative education text-books of that time consisted, with few 
exceptions, of a collection of chapters, each describing a particular 
nation’s system of education. In the fifties, parts of one system were 
placed side by side with similar parts of another system and were 
described in more detail than when the systems as a whole were com- 
pared, Bereday (1964) has called this the “juxtaposition” stage. The 
emphasis has been on the exchange and collation of descriptive ma- 
terial. International agencies such as UNESCO, O.E.C.D., I.B.E. and 
the Council of Europe's Council for Cultural Co-operation, have 
helped to intensify this exchange and collation, with the result that 
there exists a wealth of data relating to different patterns of educa- 
tional organisation, curricula and teaching methods. However, where 
any analyses-of these data have been undertaken, these have been of 
a qualitative nature and usually within countries. 

It has become increasingly evident that formal education plays 
an important part in the social, economic and technological develop- 
ment of a country; at the same time, the scarcity of resources has 
made it impossible both in developed and developing countries to 
satisfy the growing demand for educational expansion and this, in 
turn, has underlined the need for a critical inquiry and re-appraisal 
of some of the educational practices in existence today. Anderson 
(1961) has indicated the need to introduce into comparative educa- 
tional studies established procedures of research and quantitative 
assessment, so as to gather information not only about the “effi- 
ciency” of various types of educational systems, but also about the 
“efficiency” of various educational practices within them. Bereday 
(1964) too, has emphasised the need for an analytic (qualitative and 
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quantitative) stage in comparative education—the post-juxtaposi- 
tion stage. As a result of such cross-cultural analyses it should be 
possible to draw conclusions on the basis of inductive reasoning. 

The efficiency (in terms of optimum production of learning— 
both cognitive and non-cognitive) of schools in various nations is 
attacked and defended usually without solid evidence to support 
the claims of either attackers or defenders, with the result that pol- 
icy is often made on the basis of assumption and impressionistic and 
incomplete evidence. A United States admiral, in a widely publicised 
article in 1965, contended that one school year in the United States 
would be worth only two-thirds of a school year in Europe, but, as 
yet, no evidence has been gathered by which this impressionistic 
statement can be confirmed or rejected. The type of statistics which 
have so far been collated and classified concern “input” variables to 
the school system (e.g. statistics concerning teachers, buildings, finan- 
cial expenditure per student, curricula, etc.) but no systematic 
measures of qualitative “outcomes” have been made (cf. Harbison 
and Myers, 1964). 

Thus, in order to examine the “efficiency” according to certain 
criteria of systems as a whole, or of particular educational practices, 
it is necessary to have measures of the “outcomes” of the various 
systems. This implies that internationally valid cognitive and non- 
cognitive measures (in the form of tests, attitude scales and question- 


naires) are used, so that comparable data are obtained about a num- 
ber of educational systems at the same time. 


Such data are of special value: 


1. when one wishes to study the relationship between certain varia- 
tions in educational practice and educational achievement, but 
the practices and school structures one wishes to compare are not 
well represented within a single country, 

2. when it is desirable to test the generality or universality of a re- 
lationship that has been found in some country. 

One illustration of the former would be an inquiry into the re- 
lationship between the age of commencing formal schooling and sub- 
sequent achievement. How does achievement at, say, age thirteen, 
compare for students who entered into formal schooling at age five, 
age SIX, or age seven? The uniformity of practice within a single 


* Cf. Carnegie Quarterly, Volume XIV, No. 2, 1966: “The Gross Educational 
Product: How Much are Students Learring?” 
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country almost precludes any study of this question within national 
boundaries. It would be extremely difficult, if not impracticable, to 
set up an experimental situation within a single country. Further- 
more, it would necessitate changing many of the cultural assump- 
tions and values held by teachers, students, parents and society for 
the various experimental situations. Such variety, however, already 
exists internationally and an international study would reveal the 
diversity of practice in different countries and make data on this 
point readily available. 

An illustration of the second type of relationship is the allegation 
that boys do better than girls in certain subjects. Is this a general 
phenomenon, or is it limited to certain countries? If the latter is the 
case, what are the characteristics of the cultural patterns and of the 
educational systems in which boys do better and of those in which 
girls do better? 

Thus, an international study of education must centre on the 
kinds of questions that can be answered best (or solely) by compari- 
sions of the achievement of students in different countries, and that 
can be answered poorly, if at all, by studies of students within a 
single country. The school systems of the world represent a series of 
environments in which human beings learn, and as a group are much 
more varied and contain far greater differences than can usually be 
found or created in any one system. Thus, educational quasi-labora- 
tory situations exist in which many of the important questions con- 
cerning human learning can be studied objectively, though there 
is still a great deal of difficult work involved in specifying such 
environments with reasonable accuracy and in comparable and 
meaningful ways. 

The design of the international research study reported here is of 
the survey type using random probability sampling techniques. As 
the survey approach has the advantage of examin- 
ing practices as they exist, and with the surrounding philosophies 
and values concerning those practices held by the students, teachers, 
parents, and other members of society. Degrees of association between 
certain independent (input) and dependent (output) variables can 
be measured, as well as between certain of the independent or de- 
pendent variables themselves. Although it is more difficult to infer 
cause and effect relationships than in a controlled experiment, it 
can be argued that it is extremely <difficult to set up a controlled 


implied earlier on, 
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experiment in the educational field for examining certain problems 
(cf. Carroll, 1963, Kish, 1965). For example, for a controlled experi- 
ment involving an examination of streaming, it is important that 
teachers teaching streamed classes should believe in the principle of 
streaming and vice-versa for those teaching non-streamed classes. In 
practice, this is difficult. On the other hand, it is well known Ea 
there will always be teachers of differing philosophies teaching Both 
sort of classes. A survey research can look at the situation as it exists 
and evaluate streaming versus non-streaming in their various con- 
texts. This is obviously of more value than an examination of the 
problem in a artificially set-up experiment. However, it must be 
borne in mind that only experimental studies allow conclusions of 
cause and effect relationships. Any notion of cause and effect from 
survey research is strictly inferential. 


The present study has drawn from the data gathered by the IEA 
Project (see Husén et al., 1967) where educational research centres or 
institutes from twelve countries: Australia, Belgium, England, Fede- 
ral Republic of Germany, Finland, France, Israel, Japan, the Nether- 
lands, Scotland, Sweden and the United States, participated in a 
cross-national study of a comparison of the outcomes of mathematics 
instruction. A short account of the history of the project, the Inter- 
national Project for the Evaluation of Educational Achievement 
(IEA), as well as the problems of choosing comparable populations 
for testing and sampling them and how these were overcome is given 
in Chapter 2. The instrument construction, data collection and data 
processing are described in Chapter 3. Chapter 4 describes certain of 
the independent variables used in the study presented here. 

The educational practices chosen for study in the present book are 
those where wide variation occurs between educational systems. 
hey, therefore, concern data where a study is made of the relation- 
ship between certain variations in educational practice and educa- 
tonal achievement. Previous research and the results of this study 
are given in detail in Chapters 5, 6 and 4. A brief introduction is 
Aven here of the problems associated with each of the practices ex- 
amined. However, it must be made quite clear that these problems 
are being examined in terms of only one aspect of student achieve- 


ment—mathematics. Whether the results would be the same in 
other subject areas is a matter for future research. 
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Retentivity* 
Retentivity is a term used to describe the proportion of an age group 
being retained in full-time schooling in a system to the end of sec- 
ondary schooling. Thus, the United States system, since it retains 
nearly three-quarters of an age group in school through to the end of 
‘twelfth grade, is described as a “highly retentive” system, whereas 


_ England, retaining only twelve percent of an age group, could, in 


1964, be described as a system with “low retentivity”. 

In the United States and Japan, which are highly retentive sys- 
tems, there would appear to be a deliberate policy of encouraging as 
many students as possible to continue through to the end of second- 
ary schooling. In many European countries, there has been a policy 
of gradually selecting out a small élite which has been allowed to 
continue through to the pre-university year. Theoretically, of course, 
each child is allowed to continue through, but usually on condition 
that various academic (and selective) hurdles are overcome. In the 
last decade in Europe, as steps have been taken to broaden the op- 
portunities for secondary and higher education, the objection has 
frequently been raised that, if more students are allowed through 
either to the pre-university year, or to the university, this will mean 
a “lowering of standards”. Unfortunately, when asked for an opera- 
tional definition of “standards”, those who use the term are either at 
or suggest, that “standards” refer to the mini- 


a loss to supply one, 
k that has emerged over the years 


mum requirement for a “pass” mar’ 
(cf. Husén, 1966). 

By the use of internati 
to compare the outcomes 0 


onally valid mathematics tests, it is possible 
f students both studying and not studying 
mathematics in the pre-university year. It is possible to compare the 
outcomes from various points of view. First, it is possible to compare 
the average performance; it is often asserted that the “standard” of 
performance of the students in the pre-university year in the Euro- 
pean low retentivity systems is higher than that of the United States 


twelfth-graders—is this true or not? Secondly, it is possible to ex- 


amine the relative performances of students at different parts of the 


distribution of scores in each system. Thus, for example, how do the 


top five percent in school in England compare with the top five 


Jem have also been taken up in the IEA international 
67) by the present’author and others. 


* Some aspects of this prob! 
Publication (Husén et al., 19! 
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percent in school in the United States? Is it true that if more students 
are allowed through to the pre-university year, this will mean a low- 
ering of “standards” for the “best” students? Since the degree of re- 
tentivity varies greatly from country to country, it is obvious that a 
comparison of international percentiles referring to the composite 
distribution of pre-university mathematics (and separately non- 
mathematics) students is not fair to the highly retentive systems. 
Therefore, it is necessary to go one step further and calculate the 
proportions of a total age group reaching various levels of achieve- 
ment. It can be appreciated that a higher proportion of students in 
full-time schooling in a low retentive system are likely to reach, say, 
the international 95th percentile than in a high retentive system, but 
that when the same two countries are compared in terms of the total 
age group reaching the gsth percentile, the reverse may be true. Cal- 
culating the proportion of a total age group reaching certain “stand- 
ards” (in terms of international percentiles) introduces the concept 
of “how many students are brought how far” in a particular system. 
It is possible to develop this line of thought and calculate an 
“achievement yield” of particular groups of students, This takes into 
account the percentage of an age group reaching a particular level of 
achievement, and is not simply a comparison of means between 
countries irrespective of the differing percentages of an age group 
making up the population being compared. Furthermore, it is pos- 
sible to compare the “increase” in yield between a point where one 
hundred percent of an age group are in school (in this study, 13-year- 
olds) and the pre-university year. Ideally, it would be desirable to 
measure the “total yield” of achievement of a system. This, however, 
would require measuring achievement of all those dropping-out of 
school at the points at which they drop out. Another approach would 
be the longitudinal, Measuring student accomplishment at the be- 
ginning and at the end of a given school year or stage. 


Differentiation 


Differentiation is a term used to describe 
students by some Particular criterion into 
different classes within schools (Husén, 
education, students are separated, usu 
ages of ten and twelve, on the 


the policy of grouping 
different schools or into 
1962 a). In selective systems of 
ally somewhere between the 
basis of ability and/or achievement, 
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into separate school types. The more able students go to a selective 
academic school (grammar school, lycée, Gymnasium, etc.) and the 
others continue in a form of elementary school (modern school, 
école primaire, Volksschule, etc.). This type of differentiation is 
sometimes known as “organizational differentiation” or “inter- 
school grouping”. When a similar form of grouping is practised 
within schools (grouping students by ability or achievement into 
classes) this is sometimes known as “educational differentiation” or 
“intraschool grouping”. 

In the twelve countries participating in the IEA study, there was 
more diversity between countries than within any one country in the 
forms and amounts of differentiation employed. Previous studies 
(see Chapter 6) have implied that the more differentiation practised 
either within a system or within a school the larger will be the range 
of achievement; at the same time, there is other evidence (Marklund, 
1962, Svensson, 1962, and Husén et al., 1967) to suggest that the mean 
scores of “bright” students are, in the long run, much the same 
whether they have been subjected to the policy of differentiation or 
not, but that “duller” students achieve more when in a non-differ- 
entiated system of education or school than in a differentiated one. 
However, in any system of education, it can thus be argued that it is 
the achievement of one hundred percent of an age group which is as 
important, if not more important, than the achievement of a small 
élite. It is, therefore, of interest to examine the range of scores on an 
achievement test in relation to the amount of inter- and intra-school 
grouping practised in various systems of education. If it is true that 
f scores are associated with the amount of differentia- 
then educational policy makers, planners and admin- 
are of this when planning policy. It is also of 
interest to know the relationship of inter- and intra-school grouping, 
both together and separately, with variability of achievement. For 
example, if it is planned to change from a selective to a comprehen- 
sive system of education, but it is expected that intra-school group- 
ing will be practised in the comprehensive school, then what will be 
the approximate change in the variability of achievement? Alterna- 
tively, if intra-school grouping is not practised, then what might be 
the change in the range of achievement of a year group? i 

Related to the aspects of inter- and intra-school grouping is that 
of grade promotion versus age promgtion. Some systems of education 


larger ranges o 
tion practised, 
istrators should be aw 
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insist on students reaching a certain level of achievement before be- 
ing allowed to progress to the next grade; this results in certain pro- 
portions of an age group being one or two grades behind the major- 
ity of their contemporaries. Other systems allow a total age group to 
progress as an age group through the school. It is to be expected that 
a grade system will have a smaller range of achievement within any 
one grade, but a larger range over any one age group. On the other 
hand, there will be an interaction effect between the age-grade pro- 
gression (the promotion system which is in itself a form of grouping) 
and the amount of intra-school grouping practised within a grade or 
age group. Is it possible, for example, that within one year group in 
England with age grouping, but with streaming within an age group, 
the range of scores will be larger than in a system with grade group- 
ing but no streaming? 

The diversity of differentiation practised in the IEA study has 
made it possible for these questions to be examined to some extent, 
i.e., the relationships between various forms and degrees of differen- 


tiation and the standard deviation of scores. The results are to be 
found in Chapter 6. 


Specialization. and Age of Entry to School 


Two other aspects of school Organization where diversity exists 


ems but not within systems are those of specialization 


of gradually dropping subjects or not dropping them, so 
that by the pre-university year only a few subjects are studied, or as 


many as in the early years of secondary school) and mandatory age 
of entry to school, 


In England and Scotland, students in the penultimate and ulti- 
mate secondary school years study an average of three of four sub- 
Jects only; in the United States, students in twelfth grade take three 


or four “solids”, but it is theoretically possible that in eleventh grade 
they could have taken three different “solids”. In many Western 
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be given, since with the speed of technological change in today’s 
world, many persons will have to be retrained several times in their 
lifetimes for new jobs, many of which do not even exist today. 
Furthermore, the fact that specialization takes place in the last years 
of school has a backwash effect, with the result that many students 
who drop-out of school before reaching the pre-university year have 
already dropped some subjects and in some cases are studying clus- 
ters of subjects which are arts or science biassed. Those in favour of 
specialization argue that it is important to concentrate on only a 
few subjects, since this keeps up “standards” of achievement in the 
pre-university year, that the universities require this specialization 
and that by studying a subject in depth, students are more capable 
of appreciating higher thought processes and that their achievement 
will be of higher level than those who study more subjects. 

Thus it is of interest to compare the achievement of pre-university 
students from different countries according to whether specialization 
is practised or not. In general, within a country where, on average, 
few subjects are studied, it is difficult to examine the problem, since 
it is the “brighter” students who tend to study more than the average 
number of subjects. It should not be forgotten, however, that there 
are difficulties in making a straight comparison between countries 
on this variable, since differences between the groups of students 
exist which are of importance, notably that the average age of ter- 
minating the pre-university year is different from country to country 
and that the percentages of an age group going through to the pre- 
university year also differ. 

England and Scotland have a mandatory age of entry to school of 
five years, Sweden and Finland of seven years and the other countries 
in the IEA study of six years. The median age of entry differs 
slightly from the mandatory age, but not sufficiently to require a 
different categorization in terms of the average length of schooling 
up to a particular point later in the systems. This particular divers- 
ity in educational practice has been mentioned earlier in this chap- 
ter as an illustration of the advantages of international educational 
research over national research. However, within some countries 
there is some small variation and interesting national studies have 
been carried out (Pidgeon, 1965). Those who support an earlier age 
of entry to school maintain that early entry makes early learning pos- 
sible and that students who enter eaflier will learn more than those 
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who enter later; furthermore, it is easier for them to learn social 
adjustment to their peers at an earlier age, and that for “culturally 
deprived” children the deprivation can best be compensated by 
bringing the children to school earlier. 

In this study, it is possible to compare the achievement of 1 3-year- 
olds in twelve countries and relate this to the mandatory age of entry 
to school. It is also possible to compare the relative achievement in 
various socio-economic status groups on the same variable. Do, for 
example, low socio-economic status group 13-year-old students have 
higher achievement scores in those countries where they begin school 
at five years of age than in those countries where they begin at six or 
seven? j 

It has been shown that when pre-university students’ mathematics 
Scores are adjusted for differences in age and retentivity in the diffe- 
rent systems, the differences in scores between countries are much 
the same as at the 13-year-old stage (Husén et al., 1967). This being 
so,ʻit is interesting to add other features of school organization to 
that of age of entry and examine to what extent school organiza- 
tional differences can account for the differences in score. It is not 
likely that this will be very great, since, on the basis of previous 
knowledge (Peaker, 1967) it is known that school and teacher vari- 
ables account for a relatively small amount of the variance of scores. 
Nevertheless, it is of interest to those concerned with school organiza- 
tion to be aware of the effects of their policies. 


Summary 


Comparative education as a discipline has now advanced to the stage 
where it is necessary to carry out cross-national empirical studies of 
not only the input (independent) variables to systems of education, 
but also the “outcomes” (dependent variables) of the systems. Data 
collected in international Studies are of special value: 

1. when one wishes to stud 
tions in educational pr 
the practices one wish 
within a single country. 

2. when it is desirable to test the 
lationship that has been found i 


‘ š r 

y the relationship between certain varia- 
actice and educational achievement, but 
es to compare are not well represented 


generality or universality of a re- 
n some country. 
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Furthermore, international surveys of educational systems have 
certain advantages over small-scale controlled experimental studies. 
First, they involve replication and secondly, the practices being studied 
exist in their natural contexts with all the concomitant philosophies 
and value systems as they exist in practice. In a controlled experi- 
ment, it is often extremely difficult to control variables such as 
teacher attitude (philosophy) and once it is carried out, it requires 
replication. 

The International Project for the Evaluation of Educational 

» Achievement (IEA) has recently undertaken a study of mathematics 
achievement in twelve different school systems (Husén et al., 1967). 
The data presented in this book come from the IEA study. The edu- 
cational practices examined are those where there is considerable 
diversity between countries and considerable uniformity within 
countries. 

The first practice is that concerning the differing proportions of 
an age group continuing through to the pre-university year (retenti- 
vity). It is intended to examine the differences in “standards” of 
performance associated with differing degrees of retentivity in terms 
of average performance, fixed international standards performance 
and “yield”, the latter being a measure of how many students in cer- 
tain defined populations are brought how far in terms of achieve- 
ment within any one system. These results are reported in Chapter 5. 

The second practice is that of differentiation. Students are differ- 
entiated into different school types (inter-school grouping) and into 
different groups within schools (intra-school grouping) to differing 
degrees formally on the basis of ability and/or achievement. It is 
possible to examine the association between these two forms of dif- 
ferentiation and the spread of achievement scores. Further, practices 
differ between countries as to how students are grouped in connec- 
tion with promotion policies; some countries have a system of grade 
promotion and others a system of age promotion. It is possible to 
examine the spread of scores in connection with these forms of 
grouping and in turn the relation between these two and the relation 
between spread of achievement scores and intra-school grouping. 
These results are reported in Chapter 6. 

The third and fourth practices concern the number of subjects 
studied in the pre-university year and the mandatory age of entry to 
school. It is possible to compare thesmathematics scores of students 
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from countries where nine or more subjects are studied with stu- 
dents’ scores from countries where only three or four subjects are 
studied. The mandatory age of entry to school ranges from five to 
seven years of age in the countries participating in the IEA project. 
Is earlier mandatory age of entry to school associated with higher 
achievement scores at age 13 in general, or only for some social 
groups? Are there other school organizational features which account 
for differences in score between countries at the 13-year-old level? 
These results are reported in Chapter 7. 

All of these problems are those on which some light can be shed 
from the results on an international study, but which would be diffi- 
cult to examine within a single nation. However, it must be remem- 
bered that these results refer only to mathematics achievement; it 


would require further research to check these results in other subject 
areas, 
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CHAPTER 2 


IEA, Populations and Sampling 


International Project for the Evaluation of Educational 
Achievement (IEA) 


The data used in this study were collected by the International Pro- 
ject for the Evaulation of Educational Achievement (IEA), and since 
IEA is the first large-scale international educational research project 
of its kind, it would seem appropriate to describe briefly its history, 
structure and mode of operation. A detailed report of the IEA pro- 
ject is given in Husén et al. (1967). 

In the middle fifties, groups of educators and educational research- 
ers from different countries had met at places like the UNESCO In- 
stitute for Education, Hamburg, to examine problems such as those 
concerned with school structures and organization, selection pro- 
cesses, examinations and failure in school. Two important publica- 
tions emerging from some of these meetings were edited by Hotyat 
(1962) and Wall (1962). Throughout these meetings there was a 
growing awareness of the need to establish evaluation techniques 
which would be valid cross-nationally. At the same time, more or less 
independently of each other, several researchers in the United States 
(Anderson, Bloom and Foshay) began to consider the possibilities of 
undertaking such research. 

In 1958, researchers from several countries came together at a 
meeting in Eltham, England, chaired by Dr. W. D. Wall of the 
National Foundation for Educational Research in England and 
Wales, and also at the UNESCO Institute for Education in Ham- 
burg. At those meetings it was decided to carry out a pilot study to 
discover if an international research project would be administra- 
tively possible and if the results could be expected to be meaning- 
ful. Research Centres from Belgium, England, Finland, France, Ger- 
many, Israel, Poland, Scotland, Sweden, Switzerland, the United 
States and Yugoslavia took part. A strategic target population in 
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those countries was the children of age 13:0 to 13:11, since this was 
the last point where practically all of an age group were still in 
school in all countries. In most cases, children of schools or areas 
which were known to be close to the national mean and standard 
deviation were tested, and thus, there was no strict probability 
sample. In all, 9,918 students spread over eight languages were ad- 
ministered tests (a total of 120 items) of reading comprehension, 
mathematics, science, geography, and non-verbal ability. The ven- 
ture proved to be successful. Foshay et al. (1962) have presented some 
of the results of this study in a monograph. i 
At a meeting at the Unesco Institute for Education, Hamburg, in 
June 1960 it was decided to embark on a cross-national study in one 
subject area, where several populations within secondary education 
would be sampled using random probability sampling techniques 
and where specific testing instruments would be specially con- 
structed. This first carefully designed study in one subject area 


would be known as Phase I and it was hoped subsequently to em- 
bark on further phases, 


The subject chosen for the first 
matics. The primary reason for thi 
involved in the project were conce 
tific and technical education, at th 


of mathematics. Secondly, many recent national and international 
surveys (as carried out by the National Science Foundation in the 
United States and O.E.C.D. in Europe) have re-examined the cur- 
ricula and the methods of teaching mathematics and various 
higher branches of mathematics. Thirdly, the so-called “new mathe- 
matics” has been introduced to varying degrees in some of the 
participating countries. Fourthly, since the symbols of arithmetic 
and mathematics are, with trifling exceptions, international prob- 
lems of semantics and language would be reduced. 

The Research Centres which committed themselves to Phase I at 
the 1960 meeting were from Belgium, England, Finland, France, Is- 
rael, Japan, the Netherlands, Scotland, Sweden and the United 
States. It was in late 1962 and early 1963 that Research Centres from 
Australia and Germany entered the project, (The main persons in 
volved from each of the Centres as well as consultants are listed in 
Table Aı in the Appendix). A research grant from the United States 
Office of Education was received in the summer of 1962 and this 


phase of the project was mathe- 
s choice was that most countries 
rned with improving their scien- 
e basis of which lies the learning 
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covered the international costs and the United States national costs 
only. The representatives of the Research Centres from these twelve 
countries formed themselves into a Council whose main task was to 
agree on the overall policies of the research work. On average, they 
met for a week once a year. They elected a Standing Committee of 
five of their members and their task was, if necessary, to take major 
decisions between Council meetings on behalf of the Council. Fur- 
thermore a Chairman/Technical Director was elected whose task 
was to attend to the day to day running of the project. He was as- 
sisted by a Project Co-ordinator, who was appointed in 1962 and 
placed in the UNESCO Institute for Education, Hamburg. 

In such a project, the lines of communication were long, and it 
was very important to set deadlines for various stages of the work 
and to adhere to them. Several languages were represented, and it 
was decided that the project should be conducted in English, with 
occasional French translation. Although there were some misunder- 
standings, they were fortunately rare. Lessons were learned from ex- 
perience and improvements in the mode of operation were continu- 
ally undertaken. A list of “lessons learned” is given in Chapter 2 of 
Volume I of the international publication. 

Consultants were employed in the areas of mathematics education 
test construction and sampling, and these consultants attended all 
Council meetings as well as special group-work meetings, which were 
sometimes held between Council meetings. A great deal of group 
work was also carried out at Council meetings; thus, for example, 
further work on mathematics test construction, attitude scale con- 
struction, questionnaire construction, formulation of hypotheses and 
sampling took place in the early meetings. After the full testing, all 
members helped in writing up the outcomes of the testing of hy- 
potheses. » 

In its turn, the National Centre, although using most of its own 
staff on the national work involved in the project, sometimes used 
sampling consultants. At the content analysis stage at the beginning 
of the project, the National Centre had to organize national com- 
mittees of mathematics educators and at the coding and punching 
stage, they often had to employ extra coders (mostly university stu- 
dents). 

The data were put onto magnetic tape at the University of 
Chicago Computation Center. Needtess to say, with approximately 
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fifty million pieces of information, this study could never have been 
completed without the use of a computer. That the whole project 
(mathematics phase) was completed within four years, even with the 
help of a computer, was, in itself, an enormous achievement—the 
work on content analysis was begun at the beginning of 1962 and 
the final research reports were completed at the end of 1965; this 
success was due to the dedication, enthusiasm and ability of all the 
educational researchers concerned. The data on the master and 
working tapes at the University of Chicago Computation Center will 
form a data bank which can be used by qualified research workers. 
A Data Bank Manual has been prepared by Richard M. Wolf 
(1967). 

The IEA Council has decided to embark on a second major phase 
where testing in other subject areas will be undertaken, and the 
frame of reference of the research will be extended in terms of the 


various psychological, social, cultural and economic forces involved 
in the process of education. 


Populations Tested 


One of the most difficult problems in a comparative study of this 
nature is deciding which populations in the different countries are, 
in fact, for one’s purpose comparable. The pilot project (Foshay 
et al., 1962) had focussed on the educational attainments of 13-year- 
olds. This group has the merit of being the highest age level at 
which, by law, all children are supposed to be attending school in 
most countries with a tradition of universal education. The 18-year- 
old group had distinct advantages, therefore, for an assessment of the 
educational standard reached by an approximation of a total age 
untry and was thus selected. Although this group 
ly comparable, there were difficulties in that there 
is a wide variation between countries as to the grades in which 13- 
year-olds are to be found. In some countries, its members were nearly 
all in the same grade, while in other countries, because of retarda- 
tion or acceleration policies, they could be spread over several grades. 
For example, in England, Scotland and Japan, approximately ninety- 
1 A copy of the Data Bank Manual 


Coordinator c/o Unesco Institute for 
70, Federal Republic of Germany. 


was chronological 


l can be obtained upon request to: IEA 
Education, 2 Hamburg 13, Feldbrunnenstr. 
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nine percent of a year group are to be found within the same grade, 
whereas in Belgium, for example, twenty-nine percent of 13-year-olds 
are retarded by one, two or three years. In the latter case, it was 
thought to be difficult in the testing programme to have all of these 
children brought from the different classes, and in certain cases, dif- 
ferent schools, to the testing session. It was therefore decided to 
allow Research Centres to award a notional zero score to those chil- 
dren whom they considered to be so retarded as to be unable to 
attempt any of the questions in the tests. However, in most cases, all 
students of this age range were, in fact, tested. 

A second population, which is the complement of the first popu- 
lation, is that consisting of all students at the educational level 
(grade level) typical of the 1-year-olds in each country. This, then, is 
an educational level population designed to correspond in general, 
to the age represented in the first population. The 13-year-old age 
population was designated Population 1a, and the 13-year-old grade 
group was designated Population 1b. 

The grade group, containing the majority of 13-year-olds will, of 
course, be different according to the time of year chosen for testing. 
Take a hypothetical example of two year groups: a) 13-14 and b) 
12-13 at the beginning of the school year. Then, further assume 
that the school year runs from April to March in the next calendar 
year. Thus, if testing takes place between April and September, the 
13-year-old grade group which will be tested will be group a, but 
after September, will be group b. To avoid disparity, it was agreed 
that the tested group would be the grade where the majority of 18- 
year-olds were to be found within three months of the end of the 
current school year. It must be pointed out that in almost no country 
did Populations 1a and 1b represent students at any terminal point. 
Therefore, their achievements are not to be considered indicative of 
what has been achieved in a rounded-off course of study. They do, 
however, provide a more or less hundred percent attendance base- 
line against which further learning within the system of secondary 
education can be measured. my) 

Another group of students who seemed of special interest were 
those who were just completing the pre-college or pre-university level 
of education. This represents a major transition point in each educa- 


tional system and also is the termination of formal schooling in each 


country. It is also a point which can be said to be that where the 
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“fruits” of education may be assessed. Obviously, however, there are 
important differences between countries in the composition of these 
groups. For example, the average age of completing pre-university 
education ranges from 17 years 2 months in Australia to 19 EATS AO, 
months in the Federal Republic of Germany (cf. Chapter 14 ie 
Vol. I, Husén et al. 1967). Again the age at which students begin 
school varies from country to country, and thus the total length of 
schooling varies. Secondly, it can be argued that the second and 
third year sixth-former in an English state school is not the equiva- 
lent of an American 12th grader or even of a Swedish studentexamen 
student. Apart from different lengths of schooling, the selection pro- 
cess which has taken place in each of these systems is very different 
in terms of grade-repeaters and drop-outs, and the number or the 
percent of a year group in this pre-university year also differs from 
country to country. Thirdly, the number of subjects studied in the 
pre-university year ranges from an average of three in England to 
nine or more in some European countries. Thus, there are differ- 
ences in the structure of this transition 
other, and this must be borne in mind in the interpretation of the 
results. However, it was decided that the advantages of working at 
the pre-university major terminal point appeared to outweigh the 
disadvantages of lack of comparability, so this population was 
chosen, It was divided into two sub-populations on the basis of the 
curriculum being followed. One sub-population consisted of those 
taking mathematics as a major subject. The second group was made 
up of those who were not taking mathematics or for whom mathe- 
matics was a minor and subsidiary part of their programmes. In most 


cases the two groups belonged to different sections or tracks of the 
pre-university school. 


Between the 13-year-old level and th 
are various major terminal points in t 
of compulsory school ranging, for exa 
many to 16 years in France, Sweden 
jor examination points such as the 
Thus, in some countries these 
minating their education at t 
countries they represented a 
lower and the pre-university 
tries could choose the popul 


point from one country to an- 


e pre-university year, there 
he school systems—€.g. end 
mple, from 14 years in Ger- 
and the United States, and ma- 
G.C.E. “O” level in England. 
populations represented students ter- 
he intermediate level, and in other 
kind of half-way point between the 
populations. It was decided that coun- 
ation(s) they wished to test at these in- 
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termediate points. The following are the formulated definitions of 
the target populations. As indicated above, it was stated that testing 
should take place within three months of the end of the academic 
year. The mathematics tests (see Chapter 3) given to the students in 
each population are given in parentheses: 


Population 1a: 


All students who are aged between 13:0-13:11 years at the date 
of testing. This means that all types of schools with students of 
this age should participate and be represented according to 
their proportions of students from the population defined. 
(These students were to be given Mathematics Tests A, B and 
C.—See page 42.) 


Population 1b: 
All students at the grade level where the majority of students of 
age 13.0-13.11 are found. 
(These students were to be given Mathematics Tests A, B and 


C) 


Intermediate Populations (Optional): 
These target populations were defined by the countries testing 
at these levels. It was desirable, however, that, where possible, 
these populations should be taken at points which, if terminal, 
did not lead to universities or similar institutions of higher 


learning. 
(These students were to be given Mathematics Tests 3, 4 and 5.) 


Population 3: 
All students who are in the grades (forms) of full time study 
in schools from which the universities of similar institutions 
of higher learning normally recruit their students. These stu- 
dents, in most countries, were in the grades (forms) from which 
a qualifying examination for the university of similar institution 
was taken, e.g. Abitur, Studentexamen, 2° partie du baccalauréat, 


Eindexamen, G.C.E “A” level. 


Qualification—This did not include the small proportion going 
to universities or similar institutions of higher learning via institu- 
tions which came under the heading; of “Zweiter Bildungsweg”, but 


29 


the proportion of the population had to be known. Population 3 is 
divided into two parts: 


ga: Those studying mathematics as an integral part of their eo 
for their future training, or as part of their pre-university stu : 
ies, e.g. mathematicians, physicists, engineers, biologists, etc. or 
all those being examined at that level. (These students were to 
be given Mathematics Tests 5, 7, 8 and 9.) i ak 
3b (highly desirable, but optional): Those studying peee 
as a part (complementary) of their studies and the remain: a 
(These students were to be given Mathematics Tests 3, 5 and 6). 


Where Centres wished to sub-divide any of the above populations 
for national purposes, they were, of course, allowed to do so. . ; 
For purposes of coding, it was then necessary to create ‘‘opera- 
tional groups”. For example, in the following section, it can be SERR 
that Groups ı and 2 form Population 1a, and Groups 1 and 3 form 


5 . rational 
Population 1b. Populations were thus broken down into operationa 
groups as follows: 


Definitions of Groups 


> on 
Group z consists of those students aged between 13.0 and 13.11 


the day of testing in the grade (or year group) which contains 
the majority of students of this age. 
Group 2 consists of those students 
the day of testing who are in 
that in which the majority of this age are found. R 
Group 3 consists of the remainder of students in the grade (year 
group) from which Group 1 is taken. 
Group 4—Level 2(i) as operationally defined by National Centres. 
Group 5—Level 2(ii) as Operationally defined by National Centres. 
Group 6—Level 2(iii) as Operationally defined by National Centres. 
Group 7—Level ga as operationally defined by National Centres. 
Group 8—Level gb as operationally defined by National Centres. 
Group 9 consists of those students who are tested with Level 32 


tests, but who are possibly following a course of mathematics 
which does not clearly place them in Level ga. 


Group o consists of those Students who are tested with Level 3b 


tests, but who are possibly following a course of mathematics 
which does not clearly place them in Level gb. 


n 
aged between 13.0 and 13.11 O 
grades (year groups) other than 
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Since the intermediate populations chosen for testing in the vari- 
ous countries vary so much, it was not thought worthwhile making 
international comparisons, and therefore these populations were left 
for national analyses and not included in the international analyses 


(see e.g. Pidgeon, 1967). 


Sampling 
Sampling Units and Stratification 


The main problem in sampling was to secure a representative sample 
of the particular target populations in each country. Each national 
research centre appointed a sampling expert for its country. The 
IEA, on the other hand, decided that it was necessary to have one 
person who could devote himself more or less continuously to the 
task of examining the sampling plans for each target population 
within each country and who would enter into correspondence with 
the national sampling expert. 

Each target population was divided into a sampled population 
and an excluded population. It was agreed that where there was a 
small category of schools that, on the one hand, would be very ex- 
pensive to sample and, on the other, was so small that the results 
from it would make little difference to the general picture, it could 
be reasonably excluded. In all cases, the excluded population was 
negligible, except in Israel, where students who had recently immi- 
grated from under-privileged areas were excluded. i 

The procedure used for sampling the “sampled population” was 
that of stratified random probability sampling. The unique merit of 
probability sampling is that the standard error of the sample as a 
whole or of any part of it can be determined from the internal evi- 
dence of the sample itself. All of the countries used probability 
sampling, except for the Federal Republic of Germany (represented 
by only two of the Länder—Hessen and Schleswig-Holstein) which 
maintained that if a random process of selection of schools was used, 
many of them would be unco-operative and that it would be better 
Not to use probability sampling, but to make instead a judgement 
Sample from schools known to be co-operative. This was, of course, 
for the Germans to decide, but it i i 
in this case, supplies no guarantee of representativeness. 

In the United States, the sampling was in three stages, the first 


s clear that the internal evidence, 


31 


stage being a sampling of communities, the second a sampling of 
schools within the selected communities, and the third a sampling of 
students within the selected schools. Elsewhere the sampling was in 
two stages, with schools as the first and students as the second stage. 
Multi-stage sampling is needed, because it is impracticable to sample 
students directly in a single stage. But a multi-stage sample is bound 
to be larger, in terms of students, than a simple (i.e. a single stage) 
sample giving standard errors of the same size. 


Thus, with two stage sampling, and small sampling fractions, the 
variance of an estimate is 


a, P 

n nk 
where n is the number of schools in the sample, k the average num- 
ber of students selected within each school, § the variance of school 
means and P the variance of students within schools. The intra-class 
correlation—i.e. the measure of the extent to which students in the 


same school resemble each other more than they resemble students 
in general—is o where 9=S/S+P. 


Consequently, 
S P e PES 
ara k A 


and (k—1) 9-+1 is what Kish (1965) calls the Design Effect (Deff). 
In other words, it is the ratio of the size of the complex sample, 
in terms of students, to that of the simple equivalent sample. 


If the standard errors for the complex sample were calculated by 
applying simple rand. 
would be too small, 


The Design Effect 
reduces the intra-cla 
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Three principles of random selection of students within the 
schools were proposed: 


1. Working through the registers with a constant sampling interval 
and a random start. 

2. Taking in the students whose surnames begin with certain letters 
of the alphabet. 

3. Taking in the students whose birthdays fall on certain days, 


spread uniformly around the year. 


Research Centres were warned that, when the first principle was 
used, there is sometimes a strong tendency for schools who draw “un- 
lucky” random numbers to ignore them and to choose, by judge- 
ment, a “fairer” sample. Often the headteacher replaces what he 
considers to be “poor” students by “good” students. This method, 
in fact, was not used. A warning was also given about the second 
method—i.e, that there may be an association between the initial 
letter of surnames and ethnic or other groupings within the society. 
If this was to produce a bias, it should be avoided. Most Centres 
used the third principle. This is notionally equivalent to re-defining 
the population so that it consists only of children with particular 
birthdays. There is no reason to suppose that the reduced poe 
tion, defined by birthdays, uniformly spread around the year, differs 


from the complete population. The size of the aged epee cod 
ing to the population and the country, but ae wer er : a 
tested for each population varied from approxima a 700 v G 
All in all, the total number of students tested (including intermedi 


ate populations) was about 135,000. Le : 
Since the school had been used as the sampling ie * peas 
to deal each population sample into four ic neers ae p n 
Ahe dana ata codd By tes aee aot into four in- 
netic tape in this way. The splitting of the popu i isp 
e tri Se ee sar pap a the four sub 
é : aie i 
ind i be obtaine om 
S opeen the comparison of these. The 
samples and estimates of error from aginean 
Second advantage was an administrative one, namely, a ate 
: i o Chicago. 
sheets for each sub-sample could be shipped separate y at rm 
i € +77 remained, whereas if all had been 
Thus, if one were lost, three still rem 
shipped t 7 -cht have been lost. 
ogether, all might ha aa 
qt ard out that oat and Australia did not test Population 3b 
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3~ 671266 Postlethwaite 


and that France and the Netherlands had to be dropped because of 
several cases of undersampling of schools. The Federal Republic of 
Germany and Israel did not test Population 1a. 


Weighting? 


The actual sampling fractions differed somewhat from those =e 
gested in the original sampling design handed in by the nationa 
sampling experts. The two main reasons accounting for this dispar- 
ity were (1) the numbers of schools taken into the sample in 
each stratum were based on national statistics dating back as far 
as 1960 or 1961, and in 1964 when the testing took place, there were 
changes in the figures, and (2) in certain cases it was not possible to 
test all students drawn within schools which had been sampled. In 
Some cases the school refused to cooperate in the study, and it was 
too late to take an alternate school in terms of the test programme 
administration within that country. The differences were not great, 
however, but it was the actual and not the designed sampling fac- 
tions which were used to obtain the raising (weighting) factors. The 
weighting of each stratum sub-sample was carried out in such a way 
that the weighted number of students in each stratum was in exact 
proportion to the total number of students in 


each stratum. ‘The 
estimates of error used in reporting the results in 


this study are those 
obtained from the comparison of the estimates of each of the four 
sub-samples. The formula used for 


weighting was: 
m= =m = gry rN, m 
w Sgt = hy = 
4N 4 


Where M=the number of students i 
n=the number of students 
population 
N, = the number of students in 
m=the weighted number of 
the sample. 
aj = the weighted number of “ 


n the whole target population 
in the whole sample for the target 


the ith stratum of that apa 
“students” in the it stratum o 


students” in the first subsample. 


214 in Volume I of Husén et al., 1967. + 
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The calculations of means, standard deviations and correlations had 
to be carried out in terms of weighted N’s2 


Standard Errors 


Peaker in Husén et al., 1967 (Volume I, Chapter 9, P- 154 et seq.) has 
explained in detail the calculations of both the simple random 
sampling (s.r.s.) standard errors and th 
(c.s.e.) of sampling. 

Suffice it here to give Table 2 
and gb, a) factors by which the corresp 
be multiplied to give the complex stan 
standard errors for correlations. 

The s.r.s formula for the standard error of a correlation coefficient 
is (1—7?)/ yn. The computer obtained the s.r.s. error for each popu- 
lation in each country first by comparing the average correlation 
coefficients obtained from four replicas (sub-samples) of a 54%54 cor- 
relation matrix with the four separate coefficients obtained and then 


averaging these for each matrix. 
The s.r.s. formula for the standard € 
o/Vn- To arrive at the C.S.¢., the s.r.s. should be multiplied by the 


factor in the (a) columns in Table 2.1. It will be seen that the 


e complex standard errors 
.1, listing, for Populations 1a, ib, 3a 


onding s.r.s. estimate should 
dard errors and b) complex 


rror of a mean is, of course, 


3 The following formulae for the weighted mean, standard deviation, and corre- 


lation were used: 


Mean x Si a 


Standard deviation 


Correlation e 
ta 5x, x) VEC P w) 
o 


where w;= the weight for the ith student 


X,=the value of the X variable for the an student 
Y, =the value of the Y variable for the ith student 
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Table 2.1 (a). Factors® by which the corresponding s.r.s. estimate should be multiplied 
to give the complex standard errors and (b) complex standard errors Jor correlations. 


Populations 
1a tb ga 3b 
—_—_———, 

Country (a) (b) (a) (b) (a) (b) (a) (b) 
Australia 1.7 -03 1.7 -03 2.0 -06 = a 
Belgium 1.7 -04 2.0 -04 1.6 -07 1.9 «06 
England 1.7 -03 1.7 -03 1.3 -04 1.3 +03 
Fed. Rep. 

of Germany — — 3-3 +05 1.3 +05 1.0 104; 
Finland 1.7 +05 1.8 105 1.3 .06 1.3 06 
France 2.1 +04. 3.1 +05 tel 06 = a 
Israel — — 1.8 +03 0.9 07 = pe 
Japan 1.4 +03 1.4 .03 t .05 2.0 +03 
Netherlands 1.7 08 1.9 .05 1.6 -07 = es 
Scotland 2.9 104. 3.1 -04 15 04 1.8 +04, 
Sweden 2.3 -04 2.5 -04 1.6 .05 0.9 +05 
U.S.A. 1.7 .02 1.7 .02 1.6 .04 1.8 +04 
Mean 1g 04 2.1 104 1.4 .06 1.5 108 


* In each of the factor columns (a) the highest and the lowest factor are in bold type- 
average value of the ratios in Table 2.1 is 1.7, and that no ratios are 
k Consequently, the rule of taking two (com- 


he confidence limits can be replaced by the 
tandard errors, 


hich the data for this study are drawn. 
define the target populations 
ling procedures used. 

as a growing awareness on the part of 
ticular educatiorial research workers, of 


ing research centres in Europe and the United States joined together, 
and in 1959 undertook a small pilot project to test the feasibility 
and meaningfulness of carrying out cross-national educational re- 
Search (see Foshay, 1962). Encouraged by their success, they em- 
barked on a major research in the field of school mathematics edu- 
cation in 1962. They received financial support for their interna- 
tional costs from a grant from the United States Office of Education. 
National Research Centres were responsible for defraying the na- 
tional research costs involved in the project. Research Centres from 
the following countries participated: Australia, Belgium, England, 
Federal Republic of Germany, Finland, France, Israel, Japan, the 
Netherlands, Scotland, Sweden and the United States. Each Research 
Centre had one member on the Council of IEA, whose task it was to 
agree on the overall policy of the research. Interim decisions were 
taken by a Standing Committee (elected from the Council), or by the 
Chairman and Technical Director. Since all persons involved had 
full-time commitments in their own countries, one full-time co-ordi- 
nator was appointed by IEA and placed at the UNESCO Institute 
for Education in Hamburg. Consultants were also employed and 
Most of the work was undertaken by groups at Council Meetings, but 
Some group work was also undertaken between meetings. Instruc- 
tions were issued to National Centres in circular letters and special 
bulletins. There was a continuous two way communication between 
the research workers in the National Centres and the IEA Secretariat 
(Chairman, Technical Director and Co-ordinator). The analyses 
Were carried out by computer at the University of Chicago Computa- 


ton Center. os tari 
° . ri vhich had to be sampled and 
Four target populations were chosen which 1 Pree: 


tested by each participating Research Centre. These were 
(a) all 13-year-olds (Population 1a) 


(b) all students in the grade where most 19-year-olds were to be 
found within three months of the end of the school year (Popu- 


lation 1b) 

(c) pre-university students studying ™ 
(Population ga) 

a) pre-university students not stud 
ject. (Population 3b) 


athematics as a major subject 


ying mathematics as a major sub- 


It was possible for Research Centres to test major terminal popu- 
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lations at points intermediate to the 19-year-old and preuniversity 
populations, but this was optional. 

Probability sampling was used with the school as the sampling 
unit. In the United States, three stage sampling was used (commun- 
ity, school and students’within schools), and in other countries two 
stage sampling (school and students within schools). Stratification 
was employed so as to reduce the intra-class correlation. The factors 
by which the corresponding simple random sampling (s.r.s.) estimates 
should be multiplied to give the complex standard errors are given, 
together with the complex standard errors for correlations. 
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CHAPTER 3 


Instrument Construction, Data 
Collection and Processing | 


The aim of this chapter is to describe briefly the construction of the 
Instruments. A very full description is given by Husén et al. (1967, 
Volume I) of the construction of the mathematics tests, question- 
naires and occupational classification scheme, and the reader in- 
terested in further details is advised to refer to that publication. 


Mathematics Tests 


In order to formulate the general plan of the tests and the detailed 

specifications in terms of which they could be constructed, the fol- 

lowing steps were taken, as described by Thorndike in Husén et al. 

1967: 

1. The research centre for each participating country was asked to 
recruit a committee of mathematics educators who would prepare 
a statement describing the content and objectives of mathematics 


education in that country. 
2. These statements, so far 
amined by a working committee 0 
matics educators from several particip 
cal outline was prepared covering the top. 


reports from the individual countries. S ; 
3. The outline was circulated to all participating countries, request- 
extent to which each topic was indeed 


truction of the country. 


as they were in fact prepared, were ex- 
f mathematicians and mathe- 


ating countries, and a topi- 
ics that appeared in the 


ing judgements of the 
covered in the mathematics ins : 

4. On the basis of the responses, together with the judgement of the 
al weights were assigned to in- 


working committees, simple integr À 
dicate the importance and emphasis to be given to each topic. 


5. In addition to preparing an outline of topics to be covered, atten- 
tion was given to the types of intellectual processes to be covered. 
s 
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6. The working committee developed plans relating to the number, 
length and types of test exercises to be included. 


Each National Research Centre organized one or more committees 
to carry out a content analysis of what was taught in the various 
grades between Population ıb and the pre-university year, and in 
Some cases the analysis was carried out by school type within a 
country. The work consisted mostly of an analysis of text books, ex- 
aminations and teachers’ statements. The documents produced by 
each National Centre were then sent to the International Mathemat- 
ics Committee. 

Two initial outlines were constructed, one for Level 1 (i.e. Popu- 
lations 1a and 1b) and one for Level 3 (i.e. Populations ga and 3b): 
Each outline contained about 40 different topics. A list of the topics 
for each level is given in Tables Ao and Ag in the Appendix. In 
each case, however, the objectives or cat 


egories of intellectual process 
were the same, namely: 


A. Knowledge and information: definitions, notation, concepts; 

B. Techniques and skills: solutions; 

C. Translation of data into symbols or 

D. Comprehension: Capacity to anal 
ing; 

E. Inventiveness: re 


schema and vice versa; 
yse problems, to follow reason- 


asoning creatively in mathematics. 


In Tables A2 and A 
tives indicates the cate 
committee thought mi 
the various topics, T. 
weight to be given in 
fies great weight, 2 inte 

Before preparing 
mittee had to decide 
Three to four hours 


3 in the Appendix, the column headed Cage 
Bories of intellectual process that the working 
ght be appropriately tested in connection with 
he Importance column indicates the relative 


ents’ ability to work through an 
to develop a complex proof, this 
a task would exhaust too large (and 
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too variable) a fraction of the limited time that was available. Thus, 
it was decided to limit the tasks to those that a student could be ex- 
pected to deal with, if he could handle them at all, in not more than, 
and usually a good deal less than, five or ten minutes for each item. 

The requirement of objectivity of scoring suggested the need to 
fall back on an all-or-none evaluation of a final product—the an- 
swer—and this was agreed, not without misgivings, since it was 
clearly recognised that the restriction placed real limitations on what 
could be appraised with the test. However, the decision seemed in- 
evitable for an international study involving over a hundred thou- 
sand examinees. Furthermore, it was agreed to use mostly multiple- 
choice type items where the answer choices are supplied and the 


examinee chooses the best or correct answer. The committee recog- 


nised that there are many situations in which producing the re- 


Sponse, rather than recognising it, is an essential part of the ability 
being tested. However, the practical necessity of speeding the scoring 
of the many papers called for m ing and for as extensive a 


achine scori 
Use of multiple choice questions as seemed reasonable within the 
limits of effective measurement. I 


n the end, go of the 174 items in 
the series required the examinee to write in his answer to a problem 
while 144 items were in multiple choice format. Using multiple 
choice items also had the advantage of allowing students to fill their 
answers in directly on to an IBM 1230 answer sheet which, with 
very little extra coding at the research centre, could be scored me- 
chanically, 

National research centres and me 
Supplied illustrative items for each of the topics in the test specifi- 
cations. Using these items, and also items made available by the 
Educational Testing Service and by the University of Chicago 
Examiner’s Office, a pool of some 640 items was assembled. Items 
were selected from this pool and 24 trial test forms were produced; 
the more elementary forms contained about 22 to 25 items and the 
More advanced forms 10 to 16 items. Each form was of such a length 
that it could be easily completed within 45 to 60 minutes. Two an- 


chor items were included in all tests. ; 
The trial test forms were then circulated to National Research 


Centres, and it was at this point that, as a result of criticism from 
England, additional trial forms were prepared. Finally, there were 
twenty-eight trial forms consisting of 497 items. The objective in 


mbers of the test committee 
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preparing the trial forms was to make them inclusive, so that in- - 
formation might be obtained on a wide range of topics and formats. 

Each trial form was then translated into the various languages, 
checked, and pre-tested on judgement samples of about 100 to 150 
students in each country. Each test was pre-tested in at least three 
countries; the assignments were rotated so that different combina- 
tions of countries took each of the tryout forms. In each country 
eight or ten forms were pre-tested. According to the level of the test, 
it was tried out at the 13-year-old or pre-university level. In some, 
but not all, countries, appropriate tests were tried out at the 15/16- 
year-old level. i ; h 

An item analysis was then carried out in the National Researc 
Centres, Basically, this consisted of calculating the difficulty and dis- 
crimination indices estimated by Flanagan's procedure, for each item 
for a particular sample and reporting these back to the Test Editors. 
The results from all countries were then entered on to master tables. 

The international test committee (Test Editors and Mathematics 
Educators) agreed that it was desirable to have some parts of the test 
common to the testing at the four different levels: 


(a) 13-year-olds, and the 
of 13-year-olds 
b) an intermediate age or grade group of roughly 1 5 or 16 
S grade group gnly ie 
c) a group in the final year of secondary education, but not in 
P y 4 
programme with mathematics as a major subject of study 


(d) a group in the final year of secondary education with mathemat- 
ics as a major Subject of study 


at raction 
grade group containing the largest fractio 


It was decided to organize the test in nine one hour units, each of 
which would be 


printed in a separate booklet and each of which 
would constitute a separate “test”. The tests taken by each of the 
populations have already been given in Chapter 2 (see page 29)- 
The items, 174 in all, were selected on the basis of their content 
validity to the test Specifications and on their statistical attributes. 
In planning the content of the final tests, the editors attempted T 
maintain a balance between conventional content of mathematics 
and the newer topics that are being introdaced in at least some of 
the participating countries, 


i : aw, n 
Table 3.1 groups the items into topics in any one set of tests. I 
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Table 3.1. Summary of content of tests for different populations. 


Topic Popn. 1 Popn.2 Popn. ga Popn. 3b 
Basic arithmetic 13 3 3 g 
Advanced arithmetic 18 7 3 9 
Elementary algebra 12 6 5 
Intermediate algebra 4 16 19 19 
Euclidean geometry 13 ry: 5 13 
Analytic geometry 1 4 8 3 
Sets 4 3 4 4 
Trigonometric and circular 

functions x 3 3 
Analysis g i 
Calculus 2 

Probability : Z 
Logic 2 3 d 


the final analysis, however, seventeen different sub-scores were cal- 


culated. 
Estimates of the reliability of the total test and subscores were ob- 


tained for each population in each country, using the Kuder Rich- 
ardson procedure of estimating reliability from item statistics and 
the standard deviation. Formula 20 was used. 

Table 3.2 on page 44 gives the reliabilities for the Total Math- 
ematics Score in each country for Populations 1a, 1b, ga and gb. A 

Although the analyses in this book are mostly concerned with 
Total Mathematics Score, it is of interest to comment on the various 
groupings of items. Firstly, they were classified, by the pooled judge- 
Ment of several judges, into items calling for higher mental pro- 
cesses and those calling for lower mental procene, Lower mental 
process items are those which call for relatively routine application 
of previously learned techniques, while higher mental process items 
call for a greater amount of ingenuity and inventiveness in the attack 


1 
upon novel or complex problems. A second subdivision of the items 
was into those that consisted of 


verbally formulated items, in con- 
trast with those that involved primaril 


y computation and solution 
of a problem expressed in numbers or symbols. A third sub-grouping 
of items consisted of thòse which were judged by the mathematics 
Educators to represent the “new mathematics 


| Fourthly, items were 
. i ic, algebra, geometry, etc. 
Srouped by content areas, 1.€-, arithmetic, algebra, 8 Y: 
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Table 3.2. Reliabilities of the total mathematics score Sor populations ra, rb, 3a 
and 3b in each country. 


Country Ta 1b 3a 3b 
Australia -913 -882 867 = 
Belgium -929 -913 .906 -836 
England +951 -958 -923 -895 
Fed. Rep. 

of Germany — -897 848 -800 
Finland -888 -901 -865 844 
France -929 -927 -913 — 
Israel — +917 817 = 
Japan -941 -941 -925 +926 
Netherlands -948 -915 -794 = 
Scotland -933 -940 861 844. 
Sweden -869 -869 -897 +732 
U.S.A, -909 -906 -915 844 


Some statistical evidence was gathered on the validity of the IEA 
tests in England by comparing “O” and “A” Level students’ perfor- 
mance on the IEA tests with their performance two or three months 
later in their “O” and “A” Level examinations. The average corre- 
lation was 0.63 for “O” Level and slightly higher for “A” Level, 
which indicates that there is substantial overlapping, but that it is 
far from complete. However, in the absence of information on the 


reliability of the G.C.E., it is not possible to state how nearly the IEA 
tests and the G.C.E. are measuring the same achievements. 


Questionnaires 


as many relevant varia- 
he mathematics perfor- 
€ various countries, Among the most 
, School and the structure of the educational 
ation about these environmental fields was col- 
lected from four main Sources: the student, the mathematics teacher, 
the school principal and an expert on the educational system of each 
country. Accordingly, there were four types of questionnaires: a Stu- 
dent Questionnaire (ST 1 and 2), a Teaser Onei onire TCH s 


a School Questionnaire (SCH 1), and a National Case Study Ques- 
tionnaire. 


system. The inform 
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The data for variables on the students’ background and schooling, 
collected by means of the Student Questionnaire, concerned such in- 
formation as grade, sex, age, size of mathematics class, amount of 
mathematics instruction and homework, father’s and mother’s occu- 
pation! and education, aspirations and expectations for further 
mathematics, further schooling and occupation, best and least liked 
subjects, examinations taken and extra-curricular mathematics ac- 
tivities. The information requested from teachers concerned mainly 
teacher certification both in subject matter and professional train- 
recent in-service training, experience in 
“new mathematics” and teacher freedom. The information on school 
characteristics collected concerned school enrolment, number of male 
and female full-time teachers, number of trained mathematics teach- 
ers, type of school, the amount of educational expenditure, age range 
of students in school and school finance. The National Case Study 
Questionnaire? attempted to collect both quantitative and qualitative 
data concerning the students in full-time schooling according to 
School type, selection processes, compulsory schooling, economic data 
to determine the degree of economic, industrial and technological 
development and sociological data to determine the role of women 
in society. This latter questionnaire was completed by one person in 
each country who not only knew his own system well, but also had 
a good knowledge of other systems of education. 

Only the Student Questionnaires were pre-tested. They were ad- 
Ministered (at the same time as the mathematics trial forms were ad- 
ministered) to judgement samples of between 100 and 150 students 
in each country at both the 13-year-old level (ST 1) and the pre- 
university level (ST 2). Few modifications proved necessary. The 
Teacher, School and Case Study Questionnaires were not pre-tested 
but subjected to comments from experts in the field of questionnaire 
construction. Research Centres could, if they wished, add extra ques- 
tions to the questionnaires for the purposes of a national survey. 

It was, in some cases, necessary to adapt and modify certain ques- 


ing, teaching experience, 


1 The construction of an occupational scheme is discussed in detail a Husén 
et al. (1966, Volume I, Chapter 8)- Paternal occupation was chosen as the main 


indicator of family status. Nine categories of occupation oo age gen 
agricultural occupations were given special categories within tl £ aa he : il fi- 
culties involved in arriving at a classi e which is also a scale in 
all countries were formidable, but it was ach 


fication schem 
niewed in a limited way. 
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tions to national conditions So that a question was comprehensible 
to those answering it, or so that the information collected was com- 
parable and thus more accurate than a mere translation of the inter- 
national question; similarly, the source of information varied from 
country to country for some questions, Thus, for example, in sony 
countries, the head teacher was able to give the data on teachers 
salaries, but in other countries this information had to be collected 
from central records, Examples of the different ways in which the 
question concerning the extent to which ability grouping was prac- 
tised within schools are given in Chapter 6. f 
The coding and punching schemes for the international question- 
naires were drawn up by an international committee and these ap- 
pear in Husén et al. (1967) as an Appendix to Volume I. The es- 
tablishment of international codes was an extremely difficult exer- 
cise; the establishment, for example, of one common code into which 
all school types from all countries could be fitted proved much more 
difficult than expected, and much discussion and correspondence 
was required before all were satisfied with and understood the inter- 
national codes. It should also be pointed out that a Student Opinion- 
naire was constructed, consisting of two environmental description 
instruments and five attitude scales, but since none of the data from 


the Opinionnaire are used in this book, its construction has not been 
described here. 


Data Collection 


Administration 


used at the coding and 
the case, a small committee 
Centres’ use. Manual 1 was desi 
to National Centres concerning a 


and translating 
cular questions 
as Instructions for sending all 
€ object was to indicate vari- 
nal Centres in the field work, 


and printing the instruments; explanations of parti 
and their codes were also given, as well 
materials to the computing centre. Th 
ous methods of procedure to the Natio 
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and a uniform method of procedure at the coding and punching 
Stage, 

Manual 2 was a manual designed for the person responsible for 
the overall testing programme within any one school. The National 
Centre could decide whether or not it wished to use this in its origi- 
nal or modified form. This manual included a general account of 
what the project was, the timetable for testing (which varied from 
country to country), instructions concerning the receiving and stor- 
age of testing materials and preparation for the t 
structions concerning the lay-out of the testing room and the number 
at invigilators (proctors) required and the briefing of the test admi- 
Nistrators and instructions concerning the return of all materials to 


the National Centre. 


Manual 3 (which, again, could b 
s9 desired) was for test administrators and was the normal type of 


manual of instructions for test administration. If a National Centre 
desired to use Manuals 2 and g in a modified form, their proposed 
changes had first of all to be confirmed with the Technical Director. 
me comprised one and a half days’ test- 
, and for those schools where 


esting sessions, in- 


e used by the National Centre if 


The total testing program: 


ine: thie: 
ng; this imposed a burden on a school 
Students at different levels were being tested, this burden was con- 


siderable. In some of the countries no national survey of this kind 
had previously been undertaken. This was, therefore, a first experi- 
ence in large-scale test administration for some National Centres and 


for the schools, teachers and students in those countries. Difficulties 
Were, of course, experienced, but the results of the experience were 


Encouraging in that few data were lost because of difficulties met in 
the administration process. It was interesting tO note that'some Na- 
tional Centres, in whose countries answer sheets had not previously 
been used, decided to use them. The operation turned out success- 
fully and no difficulties were experienced; the instructions given in 
anual 3 on how to fill in the answer sheets appeared to be clear 
and comprehensive Apart from the manuals, further instructions 
we sent out in natin letters, and the main points were every so 
2 R Summarised in bulletins. e 
Most cases, the testing in the classrooms was carried out by 
teachers, but thereswexe exceptions: for example, in Belgium mem- 


€] ye 2 
TS of the psycho-socio-medicaux centres who are trained in test 


admini n 
Ministration were employed. In Finland, members of the Depart- 
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ment of Educational Research of the University of Jyväskylä each 


pan $ : art- 
took responsibility for the schools in a particular area. The depa 


3 z A ro- 
ment supplied them with cars, and they completed the testing P' 
gramme within two weeks. 


Data Recording 


The material from each school was sent to the National Centre. For 
the laborious and painstaking work of recording the data from the 
questionnaires on to punch cards or on to special answer sheets n 
signed for the IBM 1230 machine (which then produced a punched 
card for each answer sheet), each National Centre either employed 
some of its own staff or hired Special staff to do the coding, all ot 
whom worked under the supervision of the person responsible n 
the IEA project in each centre. Certain questions were asked in dif- 
ferent ways in different countries, and it was, as has already been 
pointed out, of paramount importance that the information given 
in response to each question was recorded in a standardised way 
from country to country, For this reason, the responses to as many 
questions as possible were pre-coded. Where postcoding was Ye- 


S : 2 
quired, the columns and ranges on columns (i.e., number of punci 
positions) were specified. 


To ensure standardised recording of data, certain check proce- 
dures were set up, 


which involved National Centres sending their 
own coding and punching scheme for checking to the IEA secretariat. 
After this had been approved and when coding and punching 


National Centre, the first twenty punch cards of 
each type of questionnaire, plus co 


pies of the questionnaires, were 
sent to Chicago for checking. 
National Centres were i 


had begun at the 


nformed of any errors picked up in these 


to correct them before coding and punch- 
proceeded. 


tape at the University of C 
realised that in all twelve 


countries together, 132,775 students from 
5348 schools were tested, and that questionnaires were filled in by 
13,364 teachers and 5348 headteachers, it will be appreciated that 
the amount of time required to record these data at National Centres 
was enormous. 


a 
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INPUT 


PROCESSING 


OUTPUT 


Flow Chart for Data Handling 
Files Produced 


National Centers 


A. Punch cards 


(Data) 2 
t STi 
Chicago ST2 
SCH 1 


J TCH 1 


(Punch cards from: (National Case 
STr, ST2, SCH 1, Study Reports) 
and TCH 1) 


(Answer Sheets) 


B. Punch cards 


Punch Cards IBM 7094 Computer 
(editing, sorting, an mathematics 
organization of records, tests 
student 


Master Tapes opinionaires 


IBM 7094 Computer C. Master tapes 
(scoring, transcription of 
data, weighting, and deriva- 
tion of indices) 


Working Tapes D. Working tapes 


IBM 7094 Computer 
(statistical analysis) 


E. School reports 


Bivariate Statistics 
F. Univariate 


School Reports Univariate Statistics 


statistics 
IBM 7094 Computer G. Bivariate 
(statistical analysis) statistics 


Results of Hypothesis Testing: ie Multivariate 
Multivariate Statistics statistics 


Data Processing 


Although the first data arrived in Chicago in September, 1964, pro- 
gramming had already been underway for a good nine months. The 
main programmes to be written (apart from programmes for specific 
hypothesis testing) were the editing, sorting and filing programme, 
os ‘5 programme for compiling the working tapes from the master 
as n the arrival of the Answer Sheets, there was a considerable 

Y, since it tumed out that abaut onefifth of all the Answer 


4 — 671266 Postlethwaite 
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Sheets had to have ‘their responses “re-blackened”, and a cag 
number of Answer Sheets had to be completely recopied, since their 
edges had been damaged in transit. ed ee 
The data (approximately fifty million pieces) were entered o 


j = 5 item by 
the master tape in their raw form (i.e. every response to every ite 


ere $ ional case 
every individual—student, teacher, head teacher and nationa 


. kin: 
study expert—at every level in every country). Four edited working 


i i atics 
tapes were compiled, one for each population. All mathem 


i ing on 
scores were weighted (see Chapter 2) and corrected for guessing 


the working tape, and mathematics sub-scores and various derive 
indices have been produced. Analyses were then carried out in me 
Stages: first, univariate and bivariate statistics were produced i 
each population in each country; second, specific hypotheses we : 
tested, as well as a multiple regression analysis being run. The com 
puter used throughout was an IBM 7094. The flow-chart on page 49 
may be useful in understanding the total processing system. 


Summary 


The Steps taken in the construction of the mathematics tests were: 

(a) content analysis of mathematics courses 
tives of mathematics 

(b) preliminary outline 
blue-print 

(c) topics weighted and 

(d) four hundred and 
test forms 

(e) fourteen pre- 
pre-university level on 


and statement of objec- 
i jecti st 
of topics and objectives drawn up as te 


test blue-print produced 
Ninety-seven trial items formed into 28 pre- 


old level and fourteen at 
Judgement samples of approximately 
€ach level. Each test was tried out in at least 


€ countries some tests were also admin- 
istered to 15 [16 year-olds, 


(f) item analysis 

(g) ten final tests (174 items 
common to at least two di 
different sub-scores could 

(h) evidence of the concurre 
was collected for tw 
about .65. 


) constructed such that one test was 
fferent populations. A maximum of 17 
be computed. 

nt validity of the IEA tests in England 
© populations. The average correlation was 
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Background information was collected on students by means of a 
Student questionnaire, one version being administered to 13-year- 
olds (ST 1) and another to the pre-university students (ST 2). These 


were pre-tested on judgement samples of approximately 100 students 


in seven countries. Very few changes were required. Background in- 
chools was collected by 


formation on the students’ teachers and s 
Means of a teacher questionnaire (TCH 1) and a school question- 
naire (SCH 1). Neither of these was formally pre-tested, but each 
Was worked out by experienced questionnaire constructors, All ques- 
tions and codes were found to work satisfactorily. Some difficulty 
Was experienced in the establishment of jnternational codes, but it 
Was found that the “common moulds” eventually proved appropri- 
ate. Data to provide a contextual background for the findings of the 
research in terms of the school system and societal and economic 
factors etc. were collected by means of a National Case Study Ques- 
tionnaire completed by a national comparative educationist. 

Three different manuals were produced for use by National Cen- 


tres, school testing organisers and actual testers, so as to ensure 


Standardisation of procedure throughout all the full testing pro- 
ages. In most cases, the actual 


gramme and coding and punching st 
testing was carried out by teachers, but in some cases was carried out 


by trained testers or by students of psychology or education. 

All responses to the mathematics items were recorded on specially 
Prepared IBM 1230 answer sheets. Responses to questionnaire items 
mostly pre-coded, but some required post-coding) were punched on 
punch cards at the National Centre, but only after a series of checks 
had been carried out on the punching of the first twenty of each 
type of questionnaires. Answer Sheets and punch cards were then 
sent to the University of Chicago Computation Center and there all 
responses were entered on to a master tape. Working tapes were com- 


piled, involving the weighting of scores and the derivation of sub- 
Scores and special indices. Analyses were then carried out in two 
e and bivariate statistics and 


stages—the production of univariat 
the testing of specific hypotheses. 
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CHAPTER 4 


The Investigative Situation 


. . inst 
The problems examined in the present study will be viewed again 
the background of the school or, 


ganization of the countries incio g 
The aim of this chapter, therefore, is, firstly, to describe briefly nd 
Structure of the educational systems participating in the study, me 
secondly, to describe in some detail various aspects of the ai 
relevant to the features of school organization taken up in Chapt 
5 toy, 
Before noting the differences between the structures of the eae 
it is worth mentioning several features which they obviously have z 
common, All have universal primary education. All are high ee 
technologically and industrially developed nations when compare! 
with the world as a whole. All have a tradition of education. i 
Apart from the differences in the structures, it is necessary to T 
that the Scographical and cultural contexts in which these aoe za 
are to be found vary widely. No evidence which is used in this study 
is concerned with national socio-cultural differences, and measures 
of such cultural differences, will, therefore, not be dealt with here. 
What then are the major differences in the school structures? The 
first difference concerns the age of entry to school. This varies from 
five years of age in England and Scotland (which differ in their over- 
all structures as can be seen from Figures 4.3 and 4.8), and seven 


years of age in Finland and Sweden. Since in Chapter 7, the problem 
is taken up of the association between mandatory age of entry to 
school and mathematics 


Scores at age 13, it should be pointed out 
eas children entering school at five in Eng- 
gradually led towards the formal type of ie 
there tends to be a formal type of schooling 
Furthermore, there is considerable variation 
€ proportion of an age group which attends 
garten (cf. Chapter 7). LAE 

difference is that some systems practise inter- 


that within limits, wher 
land and Scotland are 
son, in other countries 
imposed fairly quickly. 
between countries in th 
nursery school or kinder 

The second major 
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Si m 
chool grouping, where others do not. The former systems select a 


percentage of an age group (ranging from 15 to 25%) at a certain age 
out of the main school into a selective-academic school. The age of 
selection ranges from ten in the Federal Republic of Germany, to 
twelve in Scotland; the mode of selection also varies from ability and 
achievement testing plus interviews (for some) in England to teach- 
ers’ judgements alone in other countries. There is evidence to indi- 
cate that these forms of selection are associated with social factors 
even when “objective” selection instruments are used (Undeutsch, 
1960; Halsey, 1961; Douglas, 1964; Husén, 1966). The latter systems 
have no different types of institutions during compulsory schooling 
and all children, irrespective of social origin or academic ability, 
Proceed through the school without being separated from their peers. 
It is only towards the’end of the compulsory term of schooling that 
some degree of differentiation of programme is allowed. 


—4.10. National Systems of Education 


Figs. 4.1 
Australia Belgium 
Grade Age 49 
9 

1 19 1 N 

18 18 N 
H H \ 

17 17: = 
G DE G J = 

1655 16 = 
F 28 F =] 
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E 25 E = 

14E 2 4h SSS 
D Eg D Quatrième 

13- $ 43 Degré 
a GSE J 

n £g N = 
B 

11 Primary B 
A schools 2 A 

A 
10 E 
3 Prima 
9 Government 8 me, 
8 — — 
g Infants 
6 6 
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O 25 50 75 100 
Percent in school 


7 > 3 
Comprehensive Selective academic 
B J Offering courses to the remainder 
Selective vocational l of students after selection 
G 
Fig. 4.1 Fig. 4.2 
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Finland 
Grade Age 


w 


Primary 
(Junior) 


Infant 


© 25 50 75 100 


Percent in school 


Comprehensive Selective academic 
Offering courses to the remainder 
=| Selective vocational l of students after selectlon 
Fig. 4.3 Fig. 4.4 
Structures 
Before proceeding to commen 


se Study Questionnaire as well as from 
961), where this was relevant. Although 
chool have been given, the school types 
nging to one of four categories: compre- 

selective-vocational or remainder. The 


+ Similar discussions on thi 


is point are to be found in Postlethwaite, 1965 and 
Husén et al., 1967. 
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Germany (Hessen and 
Schleswig-Holstein) Japan 


(lower Wy 
Li 


Sho gakko 
(elementary) 


0 25 50 75 100 0 25 50 75 100 
Percent in school 


Germany: not all of these vocational 
schools are selective 
Comprehensive Selective academic 


i pees courses to the remainder 


E selective vocational of students after selection 


Fig. 4.5 Fig. 4.6 
first three categories are self-explanatory; by remainder is meant the 
type of school which those students attend who are not selected out 
in a selective system (e.g. Secondary Modern School in England, 
Volksschule in the Federal Republic of Germany, etc.) The propor- 
tions still in school are proportions of an age group. The grades in 
which most of an age group are to be found are given by the side of 
the age group. Grade D is Population ib in each country (see 
Table 4.1). 

In connection with the figures on pages 53-57 and also with 
Table 4.3, it should be mentioned that a) in Australia at the age of 
eighteen there is a large decline in the, proportion of an age group in 
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Netherlands 


Scotland 


AGSS=Academic General 
Secondary School 
Vocational 
Grade Age raining 


Continuatio 
F School 


0 25 50 75 100 0 25 50 75 100 


Percent In school 


FA comprehensive Selective academic 


Offering courses to the remainder 
=| EIGER wocattonial a of students after selection 


From the figure: 
school, the point 
the approximate 
through the vario 
secondary schooli 
Chapter 7 on the 
ful to provide a s 
school, the mand 
the average age 


hich selection takes place (if it does at all) r 
percentage of an age group remaining in schoo 
us grades and in various school types to the end of 
ng. Although more detailed comment is made in 
mandatory age of starting school, it would be use- 
€parate table indicating the median age of entry to 
atory age at which compulsory schooling ends and 
of students three months before the end of the pre- 
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United States? 


Sweden 
Grade- Agë „— Non-comprehensive 
- 19 (less than 1 percent) 
State vocation 
19 secondary schools 
1 AA 
18 = 
H State lower and =| 
17 Ą upper general = 
G secondary school = 
16 = 
F =| 
15 = 
5 = 
14 = 
D = 
13 
c 
12 
A 
ä 11 Elementary school 


0 25 50 75 100 
Percent in school 


+ In 1970 the system will be comprehensive 
for all children up to the age of 


Comprehensive Selective academic 


| Offering courses to the remainder 


E selective vocational of students after selection 


Fig. 4.9 Fig. 4.10 


university year. The source of the first two pieces of information is 
the National Case Study Questionnaire, whereas the last piece of in- 
formation comes from the Student Questionnaire. The data are pre- 
sented in Table 4.2. 

It must be remembered that the degree of pre-schooling (nursery 
School, kindergarten, etc.) varies from country to country—see 
Chapter 7. Furthermore, whereas in most European systems there is 
only one entry point to school each year, in England and Scotland 
there are two or three. There is evidence from England (Douglas, 
1964; Pidgeon, 1965) that the multiple points of entry, together with 
other factors of school organization, affect the size of the standard 


frequent form of school organization 


= 
It should be noted that although the most 
other forms do exist: 6-2-4, 8-4, 


has been shown ‘here, namely the 6-3-3» 
5-3-4 and 5-4-3. 2 
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Table 4.1. zb populations—designation of grades. 


Australia Ist Form—in New South Wales, Queensland, 
South and Western Australia 
2nd Form—in Victoria and Tasmania 
Belgium 5e (2e Ag in Enseignement Technique) 
England 3rd Form 
Fed. Rep, 
of Germany 7- Klasse (Schulleistungsjahr) 
Finland 7 in primary school 
1 in civic school 
3 in secondary academic school 
France 5e (C.S.E. in école primaire) 
Israel Khet (8th Grade of elementary school) 
Japan Ni-nen 2nd Grade 
Netherlands 6e in primary schools 
1e in other schools 
Scotland 2nd year of Secondary course (S2) 
Sweden 


Arskurs 7 


U.S.A. 8th Grade 


his present study will have a 
fferences between the average 
are of interest, but an explanation 
uation is difficult to find. 


statutory leaving 
ages in Populati 
other than that o. 

The amount 


re strictly divided into ability groups 
Comprehensive Schools in Scotland), to 

in heterogeneous groups at least to the 
age On 13 (e.g. Swedi rehensive Schools). The average amount 
orab grouping ised within schools in each „Of the partici- 
Chapter 6. 


Table 4.2. School: Median age of entry, mandatory minimum age of leaving and average 
age of completing pre-university year. 


Average age of completing 


Median age of Mandatory minimum 
pre-university year 


entry age of leaving 

3a 3b 

A _ sys 7mo. —-14-16 years 17 yrs 2 mo. — 
E Sium 6 yrs 2 mo. 14 years 18 yrs 1 mo. 18 yrs o mo. 
gree 5 yrs 2 mo. 15 years 17 yrs 11 mo. 17 yrs 11 mo. 

ed. Rep. 15 years full time 

Raed 6 yrs 9 mo. 18 years part time 19 yTS 10 mo. 19 yrs 9 mo. 
Pa and 6 yrs 8 mo. 15 years 19 yrs 1 mo. 19 yrs 2 mo. 
e 6 yrs 3 mo. 16 years 18 yrs 7 mo. 18 yrs 9 mo. 

6 yrs 3 mo. 14 years 18 yrs 2 mo. — 
Japan 6 yrs 6 mo. 14 years 17 yrs 8 mo. 17 yrs 8 mo. 
Netherlands 6 yrs 5 mo. 14 years 18 yrs 2 mo. 18 yrs 7 mo. 
Scotland 5 yrs 2 mo. 15 years 17 yrs 6 mo. 17 yrs 1 mo. 
Seden 7 yrs 1 mo. 16 years* 19 yrs 7 mo. 19 yrs 7 mo. 
Sik 5 yrs 8 mo. 16 years (Some 17 yrs 9 mo. 17 yrs 10 mo. 


states approxi- 
nately 18 yrs) 


SM a 
* . 
According to 1962 Education Act. 
Attrition Rate 
n approximate idea of the attrition 


ld be useful to examine the various 
the mathematical 


Although it is possible to gain a 
Tate from Figures 4.1-4-10, it wou 
attrition. rates in more detail. In Chapter 5; 
yields” (or “outputs”) of several systems are examined, but these 
refer only to those still in school. ‘Thus, for example, although it is 
Interesting to compare the “yields” of those in school, this approach 
has limitations, since it would obviously be of interest to know the 
“yield” of those who have “dropped out” of school. This was not 
done in this study, but it is important to be aware of the varying 
Proportions of students “dropping out” in the participating coun- 
tries. In systems where students progress through the school more or 
less in age groups (e.g. England, Japan and Scotland), it is easy to see 
how many have participated both how long and how far in the sys- 
tems. Unfortunately, in systems where grade repetition is frequent, 
or where advanced placement is common, or again where students 
may have begun school earlier than the mandatory age of entry to 
school, it is difficult, after looking at, either the age or grade drop- 
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irls of 
Table 4.3. Proportion of boys and gi"! 


Age — 
1 
Country Sex 13 t4 15 6 = 
72 
Australią B 100 92.1 69.9 gor a 2.5 
oe mi 
G 100 90.0 61.6 31-4 ont 
Belgium B 94-4 84.7 67.5 S74 = ia 
G 97-1 80.7 63.1 Sat i 54 
England B 100 100 43-4 aag ee a 
G 100 100 41.0 ama oe 
Federal Rep. 14.9* 157", | 
of Germany B 100 83.5 56.2 Stet 18.6** 27-0 
4 I 
of Sia 
G 100 83.5 55-1 29.6 ee 14,0° 
14.2 
Finland B 99.6 98.0 40.2 27.0 ate 19-4 
G 99.8 98.8 45-9 35-0 Bie 
France B Not available 
G Not available 
Israel B Not available 
G Not available 
Japan B 99.8 99.8 64.9 60.1 pp 
G 99.9 99:9 63.2 S017 ee 2.7 
g2 
Netherlands B 100 86.8 72.6 60.4 fe 11.8 
G 99.1 78.9 50.4, 30.4 +9: 
Scotland B Not available 
G Not available 28.3 
Sweden B 95.6 79-7 55-9 45:1 346 28.0 
G 96.1 83.7 59-9 46.3 ae 
U.S.A. B 96.9 95-4 93-0 86.5 748 
$ 97.0 95-3 92.6 86.0 74:3 


* Academic ** Vocational 


out figures, to have 
dents participate ho 
leaving school after 
grade) has an estim 
school. This is due 
ment. 


more than a general picture of how many si 
w far. For example, in Germany, students begin 
the age of 13, but Grade E (the post 1 3-year-old 
ated hundred percent of an age group still in 
to early starting school and to advanced place- 
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th 
€ total age group in school and by grade. 


Age 
= = 514 51.9 52-4 56.1 59-3 
15.1 48.6 48.1 47-6 44.9 40.2 ** 
14 98 49-7 51.8 545 56.5 59-5 
0.6 s9 50.3 48.2 45-5 43-5 40.5 
o2 511 54-1 52-5 53-8 57:3 
48.9 48.9 47-5 46.2 42.7 
4.9% 
24.5% T 51.6 511 52.1 49.2 57-5 61.8 
Tuk G 
Thee oe 48.4 48.9 47-9 50.8 42.5 38.2 
9.3 : 
10.3 3.8 48.8 49.0 43.8 43.8 43.8 43.8 
3-9 51.2 51.0 56.2 56.2 56.2 56.2 
50.2 45-3 45-1 47-4 52-9 
49.8 54-7 54-9 52.6 471 
50.8 50.1 50.9 50.9 50.5 
49-2 49-9 49-1 49-1 49-5 
4 51.0 51.0 51.7 51.2 50.8 
Qty 49.0 49.0 48.3 48.8 49-2 
8.o 13.9 Not available 
49 Not available 
Not available 
16.9 Not available 
17.8 Bee 51.5 49-5 47-1 49-3 51.8 59-2 
RES 48.5 50-5 52.9 50-7 48.2 40.8 
50.8 51.0 50.8 50.2 50-7 
49-8 49-3 


49.2 49.0 49-2 


p “drop out” by sex, and at the 


Table 4.3 gives both the age grou. 
d girls in each grade for each of 


Tone the proportion of boys an 
untries in the study, except for Israel; there are no figures 
made publicly available for Israel. The figures were those which 
were the most recently available in 1964 and in all cases are post 
1960. Grade D is the grade in which most 13-year-olds were to be 
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found when the testing took place (i.e. Population 1b). For gene 
the figures for the last year in school for both the secondary ac oat 
schools and the vocational schools are given, although it is only 
secondary academic schools which are considered in this study. = 
Many more details are given on the age and grade = y, but 
each of the participating countries in Postlethwaite Me Aa Ee 
Table 4.3 gives sufficient information for it to be seen = os 1 
United States and Japan (where large numbers continue ting p 
the end of the pre-university year) approximately equal ds he 
of boys and girls drop out, whereas in all other countries a ead 
exception of Finland) proportionally more girls than boys a in 
It is also interesting to note that some countries have apg on 
persuading fairly high proportions of an age group to Le saints 
tinue in school past the Statutory age of leaving; of particular 
the regularity of the drop-out in Belgium and Sweden. 


Specialization 


+ 

‘ r 

The average number of subjects studied in each grade in piace 
schooling varies from country to country. In England, for ae 
it is the custom for students to study up to nine or ten suBjec eave 
Sometimes more) until the age of 15 or 16, when they either “o” 
school or take the first major national examination, the r ee 
level examination; thereafter, they tend to study only three Xi i 
subjects. In other countries, such as Belgium, Germany and Finlance, 


a 5 ; š p he pre- 
as many as nine or ten subjects are studied right through to the p 
university year. 


In Chapter GA 
variable is the a 
students in each 


is i i i i ificatory 
an analysis is carried out in which one classifica a 
j i re- er. 
verage number of subjects studied by pre par ae 
ee, Ve ; ste a] 
of the participating countries. However, it is a 


S 7 ma rades 
interest to note the average number of subjects studied in the gra 
preceding the pre-university year. 


z ied in the 
Table 4.4 sets out the average number of subjects studied in t 
pre-university year and the f 


our preceding years in the ieee | 
academic schools or programmes. The countries are ordered accor 
ing to the average number of subjects studied in the pre-university 
yar . o . 
The figures for the United States may appear Sur prsing; Putat 
must be remembered that because of the system of credit points, 
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Table 4.4. Average number of subjects studied in last five grades 
of secondary academic schooling*. 


Pre-university 


X-4 X-3 x2 X-1 grade (X) 
Belgi 
Franss = gt gt gt g+ g+ 
Neth, j 9+ ‘ gt gt gt gt 
J erlands 9+ 9+ 9+ g g+ 
apan 
: + + + 
Finland 9+ gt 9 9 9 
Fed, Rep. 9 9 9 9 9 
of Germany 9 9 6 9 A 
eia 9 9 9 9 
re — p 9+ 8 8 
Australia 8 8 8 7 6 
Seotland 8 e 6 5 4 
a 5 4 4 4 4 
8 8 3 3 


England me 
n 14 on the National Case Study Question- 


s 
ource fo . 
; r these or 

Maire, se data was questi 


High School, it is unlikely 
ill be the same from year to 
at, from the 


co i a š . 
mpulsives and electives in the Senior 


ae = general, the figures in 

ad ies participating in this study, 

Opted specialisation, whereas the oth 

Ta education, with the exception of Austra 
S, which are half-way between. 


Engla 
her countries have continued 


lia and the United 


Summary 
must be viewed against the back- 


The r 
he results of the present study 
articipating countries. Of 


ground of the school organisation of the p 
Particular interest for the problems investigated here are the ways in 
which the students progress through the system, the points at which 
Selection takes place, and the percentages of students in the different 
forms of schools, in particular, comprehensive, selective academic, 
Selective vocational and other school types. (Figures and tables indi- 
cate these features for each of the systems.) In general, both the 


Uni Se 
nited States and Japan can be said to be retentive m that they have 
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well over half of a year group continuing through to the pee 
sity year. Sweden, however, has recently changed from the tradition 
European dualistic pattern of education to the comprehensive, but 
in Scotland, although it has a high proportion of so-called compra 
hensive schools, the system of education is still basically dualistic, 
since the dualistic pattern is preserved within the comprehensive 
school through the practice of educational differentiation. Similarly, 
it must be remembered that in England many of the “compre 
hensive” schools do not contain students from the full distribution of 
ability within the areas, as often the top ten to twenty percent m 
terms of ability are attending a local grammar school. Although in 
Germany there are some students who attend Fachschulen, Berufs- 
schulen or Ingenieurschulen full time in the last year of secondary 
education, these have not been considered in this study. 

The attrition (drop-out) rate after compulsory schooling tends to 
be very high in selective countries, but it is interesting to note how 
regular the drop-out is in both Belgium and Sweden. The age com- 
position of the pre-university year also varies greatly from system to 
system. In the United States, Scotland and Japan it is low, and in 
Sweden, Germany and Finland it is high. 

A further important factor to be taken into account when ie: 
paring systems is the amount of specialisation in the last Yio Bt 
secondary education. England and Scotland are highly specialise 


x s t 
(three or four subjects), whereas in other countries students study & 


least six subjects and usually nine or more. 
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CHAPTER 5 


Retentivity 


As was seen in Chapter 4, the attrition rate and amount of attrition 
differs considerably among the countries represented in this project. 
In general, the USA and Japan have highly retentive systems of 
education in the sense that a high proportion of each year group 
continues through to the end of secondary education. In Europe, on 
the other hand, there is a much smaller proportion of a year group 
Proceeding to the pre-university year. The different proportions are 
connected with the different philosophies of comprehensive and se- 
lective school systems as well as reflecting differing socio-economic 
structures between the countries. Secondary education in most Euro- 
pean countries has been characterised, until recently, by the selection 
and transfer of “more able” pupils into separate types of academic 
school while the rest of the pupils have remained in schools initially 
designed to provide a basic education for the majority of children 
(e.g. elementary scool, Volksschule, école primaire). 

The academic secondary school, with a long tradition going back 
to the medieval Latin school, has tended to recruit (select) the bulk 
of its pupils from the higher socio-economic strata. On the other 
hand, the development of public education in most parts of the 
United States has not been markedly affected by traditional prac- 
tices, with the result that the eight year elementary schools were not 
regarded primarily as a preparation for secondary schooling, but as 
self-contained establishments capable of extending their provision to 
satisfy the educational needs of the community. Thus, in the Euro- 
pean school systems, there developed the practice of selecting an 
élite to go through to the pre-university year, whereas in the more 
comprehensive systems (e.g. U.S.A.) the type of system was such that 
there grew up a deliberate policy of encouraging as many pupils as 
possible to cortinue through to the pre-university year (cf. Husén, 
1962). 


5— 671266 Postlethwaite s 


However, many of the European countries are at present ae 
their policies. Economic growth and the recent rapid a a 
science and technology have created the need for a more ms a jé 
period of general education for all young people and not just for ihe 
most able minority, with the result that successive increases a A 
duration of compulsory schooling have been made in most Europ! F, 
countries. Furthermore, the need for more skilled and better ne 
formed manpower has also resulted in a substantial increase, a aula 
countries, in the numbers of young people choosing to continue far 
education beyond the Statutory school-leaving age. In see | ded 
example, in 1950 only ten percent of seventeen-year-olds proc psi 
to gymnasiet, while by 1964 the proportion had risen to se 
percent (Yates, 1966). By 1970, it is estimated that nearly 30 pe eer 
will wish to enrol in gymnasiet (Dahllöf et al., 1966). This incre: dae 
Proportion of a year group continuing to the end of sigan ai 
cation is often accompanied by a restructuring of the oe 
system itself, either by the introduction of a comprehensive sys 


3 3 : TAE he aca- 
of education with no selection or by delaying selection into t 
demic secondary school, 


In the Case Study 
number of students 
as well as the 
The national st 


Questionnaire, data were collected on the we 
in each year group still in full-time schooling; 
actual number of students in each grade group: 
atistics which were the sources of these data bee 
in general, available, depending on the country, for the years E 
tween 1960 and 1963. In every case, it was the most recently Be ï 
able statistics which were used. Furthermore, the heads of ne 
Centres were asked to estimate for 1964, at the time of testing, (a) 3 
percentage of an age group in school at the pre-university level A 
(b) the Proportion who were specialising in mathematics (enrolled y 
hematics-Science programmes). The division 1p, 

non-mathematics students in the preuniyersi 7 
een discussed in Chapter 2. It would seem that T 
entres approximations were made to the neares 
hereas in others, the proportion was calculated to 
place. The actual figures supplied are used in this 


year has already b 
some National C 
whole number, w 
the first decimal 
analysis. 

These figures are 

the fourth 
has adopted 


given in Table 5-1 in which there are also given, 
column, measures of the degree to which each country 
a comprehensive- system of education. This has been 
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assessed by the percentage of students in the younger and complete 
age group (Population 1a) attending so-called “comprehensive” 
schools. This information was collected by means of the School Ques- 
tionnaire (see Appendix II, Volume I of Husén et al., 1967). A com- 
prehensive school was described as offering appropriate courses for 
students of all ranges of ability. 

From Table 5.1 it can be clearly seen that there is considerable 
variation among the countries in this study in the percentage of a 
year group continuing through to the pre-university year. Since it 
has been possible to measure the mathematics achievement of the 
pre-university students as well as the 13-year-old students! in the 
countries, it is worthwhile posing several questions concerning the 
amount of mathematical achievement of both the pre-university 
groups (in terms of the percentage of a year group still in school) 
and the 13-year-old group of students. 


Table 5.1. Indices of retentivity and comprehensive education. 


Retentivity (percentages of 


age group) Comprehensiveness 
ee (percentages of 

Country Total ga 3b Pop. 1a) 
ee 
Australia 23 14 9 70 
Belgium 13 4 9 o 
England 12 5 7 9 
Fed. Rep. 

of Germany 11 4:7 6.5 o 
Finland 14 7 7 o 
France Ir 5 = o 
Israel = 7 = 96 
Japan 57 8 49 100 
Netherlands 8 5 3 o 
Scotland 18 5-4 12.6 44 
Sweden 23 16 7 64 
U.S.A. 70 18 52 92 


SY se ee 


The rank correlations of the three indices of retentivity with the ex- 
tent to which pupils are being educated in comprehensive schools 


are 0.89, 0.76, and 0.73 respectively. 


* For descriptions of the pre-university populations see Pp. 237-239 of Vol. I of 
Husén et al. (1967). For description of the 1g-year-old grade group see p. 29 in 
this book. é 
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First of all, it is possible to examine whether there is a difference in 
the average score of students (in both of the two pre-university popu 
lations) in systems with different amounts of retentivity, i.e., if more 
students are allowed through will this lower the average standard of 
performance? Secondly, it is possible to examine the relative perfor- 
mances of the students by certain international standards by taking 
the number of students above the gsth international percentile and 
then discovering, for each nation, (a) what percentage this is of 
the students in full-time schooling and (b) what percentage these site 
dents are of a year group. This analysis will assist in an examination 
of the problem of whether or not the standard of performance of ihe 
best students in the pre-university year deteriorates if a larger Pp oe 
centage of an age group goes through to the pre-wniversity year. 
Thirdly, it is possible to examine the mathematics performance 
“yield” of the target populations in the study. By “yield” is ae 
how many students are brought how far (in this case in terms O 
mathematics achievement as measured by the IEA tests), within the 
framework of full-time schooling in the educational system. This 
takes into account both the number of persons (in terms of the per- 
centage of an age group reaching a particular level) and the level of 
achievement per person, and is therefore not simply a comparison a 
means between countries, irrespective of the differing percentages of 
an age group making up the population being compared. In this 
last case, it is also possible to compare increase in “yield” between 
the 13-year-old age Stroup (where virtually one hundred percent of 
an age group are still in school) and the pre-university group of stu- 
dents. Thus there are three main problems, all of which are related 
to retentivity, which will be examined: Average performance, Fixed 
international Standards performance and Yield. 

In this connection jt should be pointed out that there are differ- 
ences on some major independent variables among the pre-university 
populations in the countries participating in this project. There is a 
wide variation in the socio-economic status composition of this 
group, ranging from a composition somewhat similar to the general 
population in the U.S.A., to a predominantly middle-class composi- 
tion in Germany. A second major disparity is the mean age? which 
ranges from 17 years 2 months in Australia to 19 years 10 months in 
2 For a different anal 


et al. Vol. II (1967), 


ysis of age, retentivity and score see p. 68 et seq., in Husén 
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the Federal Republic of Germany. A third variation lies in the 
average number of subjects studied in the pre-university year, rang- 
ing from three in England to nine or more in Belgium, France, Ja- 
pan and the Netherlands. These discrepancies have been dealt with 
to some extent in Chapter 4 of this book and in much more detail in 
Chapter 2 of Volume I of the IEA publication (Husén et al., 1967). 

In the discussion of yield, Population 1b has been used rather 
than Population 1a, although the latter would have been better since 
it is a chronologically comparable group. However, four countries 
(Australia, France, Israel and the Netherlands) were lost at the pre- 
university level, since either they did not test Population 3b, or 
their sampling procedures were considered to be inadequate. If 1a 
had been chosen for the lower level rather than 1b, there would have 
only been seven countries left, since Germany did not test 1a. Hence, 


Population 1b was chosen. 


Average Performance 


The percentages of an age group still in school (circa 1964) in the 


two pre-university populations have been given in Table 5.1. The 


Table 5.2. Total mathematics score, means, standard deviations and N’s 
for populations 3a and 3b. 


Pre-university non 
math-science programme 
Population 3b 


Pre-university 
math-science programme 
Population 3a 


——— San 
Australia 21.6 10.5 1089 — — z 
ee 34.6 12.6 519 24.2 9-5 1004 
ngland 35-2 12.6 967 21.4 10.0 1782 
Fed. Rep. 
Divas 28.8 9.8 649 27-7 7.6 643 
Frai = 25:3 9.6 369 ame 8.3 399 
I ca 33-4 10.8 222 — — as 
tae 36.4, 8.6 146 = — _ 
Japan 31-4 14.8 818 25.3 14.3 4372 
Netherlands 31.9 8.1 462 = — m 
ea 25-5 10.4. 1422 20.7 9-5 2123 
U.S E 27-3 11.9 776 12.6 6.2 222 
ee 13.8 12.6 1598 8.3 9.0 2042 


» Means, standard deviations and N’s for Po 
given in Table g.2. 

bi `The relation of mathematics score to the percentage of an age 
group in school by country is shown for Populations ga and 3b in 
Figures 5.1 and 5.2 respectively. The rank correlations between E 
mean score and the percentages of an age group in school moa 
population are —.62 and —36 for Populations ga and gb respectively- 
The decrease in mean score as the percentage of an age group Tê- 
tained in school increases is clearly discernible in both populations, 
giving weight to the contention that the greater the retentivity, the 
lower will be the average score of those retained. It might also i 
thought that the smaller the percentage of an age group retained, 


pulations ga and gb are 


Fig. 5.1. Relation of Mean Mathematics Score to Percentage of Age Group in 


Population by Country 
(Population 3a) 


zo 
38} 
.l 
+ eE 
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Fig. 5.2. Relation of Mean Mathematics Score to Percentage of Age Group in 
Population by Country a 


(Population 3 b) 
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the smaller would be the standard deviation, since those retained 
are likely to be more homogeneous in terms of mathematics achieve- 
ment. There is some support for this, since the rank correlations 
between the percentage of an age group in school and standard de- 
viation are .20 and .6o for Populations 3a and gb respectively. The 
standard deviation is more likely to depend on how the groups re- 
tained are organized either within schools or between schools, and 
not just on the proportion retained. This must be a matter for 
further research. 


Fixed International Standards Performance 


Apart from examining the relationship between average scores and 
retentivity between countries, it is also interesting to employ another 
method of examining this problem — that of fixing a set of inter- 
national standards to find what proportion of its pre-university stu- 
dents each country has been able to bring to each of these standards. 
Thus, we can examine not only what is achieved by the best students 
in each country, but also by the less able. 
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It has already been pointed out that there are major hae 
among the pre-university populations in the various countries a 
terms of some independent variables. With all these differences ie 
mind, one might query whether it is justifiable to use combined : 
tributions of scores from all countries as a base from which to em 
percentiles for international comparisons. The reply would be eh 
whatever the national populations that contributed to pon 
them, the scores marked by the g5th and 85th percentiles of the = 
bined distributions denote fixed points which can be used for bes 
least some comparisons. For example, the gsth percentile for Popu j 
tion ga is the score exceeded by only the best five percent of the eae 
bined pre-university populations for that level. If this five s 
were composed of exactly five percent from each of the national et 
university populations, we should conclude that, in this respect 3 
least, all the participating countries were equal. If the five p a 
international élite is not so composed, the question arises wiere 
the differences are attributable, in part at least, to the varying pe” 
centages of the age group still at school. 

Table 5-3 presents for each country the percentage of those stu- 


r . ; ‘ds. 
Table 5.3. P. ercentage of pre-university mathematics students reaching given standar 


International percentiles 


Country Retentivity 25th 50th 75th 85th goth 95th 
O o o w o © o 

U.S.A. 18 36 18 9 7 gso a 
Sweden 16 81 53 26 13 8 s 
Australia 14 67 37 10 5 3 aie 
Japan 8 82 63 43 29.4 21 pee 
Finland 7 81 48 18 6 3-4 bla 
Scotland 5-4 83 44 16 9 6 af 
England 5 94 79 50 34 26 ae 
France 5 92 69 39 29.2 22 9: 
Netherlands 5 97 77 35 14 5 ES 
Fed. Rep. 

of Germany 4.7 go 63 26 11 7 ae 
Belgium 4 go 70 44 30 23 ara 
Range ôt 61 41 29 23 19-9 
Rank correlation with 5 

column 1 = 6r y =g — -47 759 meat 85 
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‘ 


dents in Population ga reaching six different ¿international percen- 
tile levels. 

For example, 36 percent of the ga Population in the U.S.A. 
reached the 25th percentile level, as compared with 97 percent of the 
ga Population in the Netherlands. First decimal places have been 
added to some entries to increase the precision of the rank correla- 
tions. These rank order correlations between the percentage of an 
age group in Population ga (i.e. Column 1 in Table 5.3) and the 
percentage of that population reaching each percentile level are 
shown in the last row of the table. 

The negative correlations indicate that the smaller the proportion 
of the total age group taking the mathematics programme at the pre- 
university stage, the larger will be the proportions reaching given 
levels of performance. Thus, those who maintain that increasing the 
intake will lower the “standards” have a point, particularly in terms 
of the bottom half of those taken in. However, it is of interest that 
the effect at the upper end of the distribution is weaker. The be- 
tween country ranges of percentages scoring above various interna- 
tional percentile points are very large, ranging from 61 percent at 
the 25th and oth percentiles to 19.9 percent at the g5th percentile 
(see Table 5-3). OF those countries where only four or five percent of 
an age group are enrolled in the mathematics programme, Belgium 
and England are outstanding, particularly in the top international 
quartile. It is remarkable that 21 percent of Belgian students achieve 
Scores above the gth percentile (as, for example, compared with 12 
percent in England) when it is remembered that Belgian students are 
studying an average of six more subjects than English students. The 
Netherlands, on the other hand, has a high proportion of students 
up to the poth international percentile, but a rapid fall then occurs. 
The U.S.A. is consistently lower than Sweden (except at the gth 
percentile), whereas Japan is consistently higher than Scotland (ex- 
cept at the 25th percentile). 

If there were no relation between th 


Scores made by the students retained, w ‘ 
country would have 5% of their 3a Population above the g5th per- 
centile, etc. It will be seen from Table 


e degree of retention and the 
e might expect that each 


centile, 10% above the goth per 
5-3 that this is not the case. Countries with a higher rate of reten- 
tion bring less than five percent to the gsth percentile. Although in 
general the less the intake the better the performance, there are some 
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interesting differences among countries with similar ae 
Scotland, England, France, Netherlands, Germany, and Belgium a i 
have similar sizes of intake, but differ considerably in the Pepai 
tions of the enrolment they bring to the international top three pe 
centile levels. earl 
Although the suggestion that “more means worse” has been ‘ti 
to have some justification, in particular in the bottom half of Be 
distribution, it is more meaningful to see whether the size of a 
“élite” group (as a proportion of the total age group) can be A 
creased by increasing the size of the intake. If the numbers rag r 
particular percentile levels are calculated as percentages of the who ‘ 
age group, some differences may become apparent. These percen 
ages are presented in Table 5-4. A 
The rank order correlations between the percentage of an ag 
group enrolled in the mathematics-scien: 
centage of the whole age grou 
are given in the last row of Tabl 


ce programme and the es 
7 i e 

p reaching various percentile lev 

e 5.4. 


Table 5.4. Percentage of age group reaching given standards. 
(Population 3a) 


= i 


International percentiles 


Country Retentivity 25th 50th 75th 85th goth 95th 
SE le k o e 
omol o ® o © g 

U.S.A, 1 a 65 $8 1.6 13 Bana 
Sweden 16 13.0 8.5 4.2 2.1 1.28 A 
Australia 14 9-4 5.2 14 7 42 ja 
Japan 8 6.6 5.0 3.4 2.3 1.68 To 
Scotland 54 45 24 8 5 32 25 
Finland 7 5.7 3-4 1.3 4 -24 ia 
England 5 4-7 3-9 2.5 1.7 30 
France 5 4.6 3-4 1.9 1.5 1.10 Be 
Netherlands 5 48 3.8 1.7 7 co es 
Fed. Rep. 

of Germany 4.7 4.2 3.0 1.2 5 32 = 
Belgium 4 3.6 2.8 1.8 1.2 92 = 
Range 9-4 6.1 3-4 X9, ee 78 
Rank correlation with r 

column 1 +.89 +255 +.15 ER pee tO 
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These positive correlations indicate that the higher the enrolment 
is as a percentage of the total age group, then the higher is the per- 
centage of the whole age group reaching various international per- 
centile levels. The greatest changes from Table 5.3 to Table 5.4 oc- 
cur in Sweden, the U.S.A. and Japan, all three countries with a more 
retentive system at the secondary level. Thus, it is possible to in- 
crease the size of the élite group (as a percentage of the total age 
group) but only to a small extent. 

Again, the between-country range varies from 9.4 percent at the 
25th percentile to .78 percent at the 95th percentile. The percentage 
of the whole group reaching particular international percentile lev- 
els is obviously a function of size of enrolment to a large degree at 
lower levels though less so at the top levels. It is perhaps not without 
significance that students reaching the ggth percentile are drawn only 
from the U.S.A., Sweden, and England (.18, .16, and .05 respectively 
of their respective total age groups). 

Performance of the élite group (in terms of the top ten and five 
percent international group), is weakly associated with size of en- 
rolment. It is Japan, Sweden, England and Belgium which are 
performing well. Perhaps the significance of this finding becomes 
more apparent when phrased in another way: it would appear that 
countries with higher retentivity are capable of bringing their best 
pupils (in terms of the same percentage of a year group) to the same 
Standards as less retentive (more selective) countries, i.e., higher re- 
tentivity does not necessarily mean lowering the standards of achieve- 
ment (at least in mathematics) of the better students. 

Similar information for Population gb is given in Tables 5.5 and 
5-6. The results agree closely with those obtained for Population ga. 
There is a negative relationship (except at the g5th percentile) be- 
tween the percentage still at school and the percentage of that popu- 
lation reaching various international percentile levels. The small 
size of the negative correlations for the 75th, 85th and goth percen- 
tiles and the positive correlation at the gpth percentile indicate that 
at these levels, the degree of retentivity is irrelevant or, at the top 
level, favourable for high scores. Again, as with ga, if the numbers 
reaching the various percentiles are calculated as proportions of the 
total age group, there are positive correlations. 

Retentivity in the terminal mathematics-science programme is neg- 
atively related to the proportions of those still at school reaching 
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. ‘ i ndards. 
Table 5.5. Percentage of bre-university non-mathematics students reaching given sta’ 


(Population 3b) 


International percentiles 


th g5th 
Country Retentivity 25th 50th 75th 85th 9° 


(7) 
(1) (2) (3) (4) (5) (6) 
U.S.A. 


1 
52 30 12 3 2 3 12 
Japan 49 81 60 38 28 ar 1 
Scotland 12.6 82 50 18 7 s $ 
Belgium 9 93 63 27 15 2 
England x 84 53 20 10 5 o 
Sweden 7 56 10 2 o e 1 
Finland 7 go 57 17 10 5 
Fed. Rep. 5 1 
of Germany 6.5 99 81 37 20 5 
Range 69 71 36 28 sI 
Rank correlation with =o +-38 
column 1 —=.99 — .28 —.02 —.09 £ 


: : 5 : PETE" itively re- 
various international percentile levels, Retentivity is positively 


lated to the proportion of the total age group reaching — = 
ternational levels. In general, the systems having smaller intake 

either ga or $b have achieved a fa 
weaker students in the 


size, it is the performan 


uirly high performance of be 
programme. When an intake is increased rio- 
ce of this lower group which tends to pa 
rate. Nations can, however, certainly increase their total pe 
ical yield” of an age group by having larger intakes (higher ret i 
tivity). In terms of the top international ten and five percents, Sa 
tentivity is only weakly related to the proportions of the total oi 
group reaching these levels, i.e., the performance of high ability $ 
dents is unlikely to be affected by increasing the intake. scene 
In Population 3a, Belgium, England and Japan have a consisten : 
high performance of all students. Sweden and Japan reer 
very well that increasing the size of the intake does not necessarily 
mean lowering standards. Sweden has an intake approximately three 
times larger than, for example, that of England, and yet approx 
mately the same Proportions of the total age group are still reaching 
goth and g5th percentiles. Again, although systems with smaller se 
takes bring these Students to higher mean scores, this is only to 
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Table 5.6. Percentage of age group reaching given standards. 
(Population 3b) 


International percentiles 


Country Retentivity 25th 50th 75th 85th goth g5th 


(1) (2) (3) (4) (5) (6) (7) 


U.S.A. 52 15.2 6.2 1.6 1.0 +52 +52 
Japan 49 39-7 29.4 18.6 13.7 10.3 5.9 
Scotland 12.6 10.3 6.3 2.3 88 -38 13 
Belgium 9 8.4 5-7 2. 1.3 +72 18 
England 7 5.9 3-7 14 «70 350-4 
Sweden 7 3.9 +70 +14 o o o 
Finland 7 6.3 3-9 1.2 +70 +32 07 
Fed. Rep. 

of Germany 6.5 6.4 5.3 2.4 1.3 +52 .06 
Range 35:8 28.7 18.6 13-7 10.3 59 
Rank correlation with 

column r 81 95 +34 +40 53 81 


expected when the selection processes and smaller numbers are con- 
sidered, What is more important, however, is the proportion of the 
total age group reaching particular levels. Here the size of intake 
may have an important effect at the lower levels (see Table 5.4, Swe- 
den at 25% level), and at the top levels it is possible for countries 
with large intakes (e.g. the United States and Sweden) to bring high 
Proportions of an age group to the goth and 95th international per- 
centiles. At the top level Finland, Australia, the Netherlands and 
Germany are performing extremely poorly. Germany is particularly 
surprising, considering its high selectivity. From Table 5.3 it appears 
that the weaker half of the U.S.A. group is below the standards of 
other countries. 

For Population 3b, Japan, Belgium and Germany perform well, 
whereas Sweden and the United States perform relatively poorly. It 
must be remembered that in Germany the gb group have all studied 
mathematics up to the end of the penultimate preuniversity year 
(i.e. the Unterprima). r 

It is interesting to note those countries whose Populations ga and 
3b both perforni well and those where there is considerable disparity. 
However, before arriving at any firm conclusions, it is necessary to 
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bear several points in mind. First, there are differences between syS- 
tems as to when students are allowed to discontinue the study of 
mathematics. Secondly, there are differences as to what discontinuing 
means; in some countries, it means absolutely no further mathemat- 
ics and in other countries it means having mathematics for one Os 
two periods a week instead of seven or eight periods a week. Thirdly, 
it must be borne in mind that the distinction between Populations 
3a and gb is somewhat circular, since, where it was difficult in some 
countries to distinguish between those pre-university students who 
were said to be specialising in mathematics and those who were not, 
a way of operationalising the distinction was to give the ga tests E 
those groups of students for whom the tests were thought to be ap- 
propriate and then the gb tests to the rest of the students. 

Another approach to this same problem described in Husén ¢t ite 
(1967) was to compare the performances of equal proportions oi 
age group; as a result, the same conclusion as above was reached, nea 
that the performance of the best three or four percent of students mn 
a country is not affected by an increase in the intake (retentivity) 
into the pre-university year, but that the average score of all those 19 
School in either the mathematics or non-mathematics programme 
will fall as the Proportion of an age group retained increases. 


Yield 


As has already been pointed out in examining the “outcomes” of a 
system of education, it is often misleading to compare mean scores: 
It would be pointless to compare the mean score of the English stu- 
dents in the mathematics programme in the pre-university year with 
the United States Students in the 12th grade mathematics pro 
gramme. It is imperative to take into account the proportion of a? 
age group still studying mathematics, i.e, “how many of these sti- 
dents are brought how far?” For example, in England only five 
percent of an age group is studying mathematics in the pre-university 
year, whereas in the United States eighteen percent of an age group 
is studying mathematics at that point. 

There are difficulties connected with the calculation of a “yield” 
or “output” measure, A simple statement ‘of the overall problem is 
“How are achievement scores and number of students having a given 
score to be combined into a single measure of output?” Two very 
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simple approaches are used here. The first consists of plotting the 
cumulative percentile frequencies (or percentile frequencies could be 
used) against the percentage of an age group in a particular target 
population and regarding the area under the curve as the “yield”. 
The second consists of multiplying the proportion of an age group 
ina target population by the mean score of the population and re- 
garding the resultant value as an index of “yield”. 

The difficulties with these approaches are best exposed by con- 
sidering the assumptions behind them: 


(a) Each correct response to an item is regarded as being of equal 
value. Thus, two students having the same scores are regarded as 
representing the same output even though one student may have 
correct responses on items which are considered to be either more 
difficult or of more value to society than another student. 

(b) Each point on the achievement scale has the same absolute value 
as every other point. Thus, the increment from 28 to 24 repre- 
sents the same increase in “output” or “yield” as an increase 

t is, of course, possible that, in some case, 20 


from go to 41. I 
and, in another case, 40 


points may be twice as valuable as 10, 
may be less than twice as valuable as 20. 
(c) One student with a score of 20 is considered equal in terms of 


yield to two students with scores of 10 each. 
(d) The value of the nth unit of achievement is assumed to be the 
although countries may differ in their eco- 


same in all countries, 
introduces the concept of “re- 


nomic structure. This, however, 
quired (by the society) yield” and its fit to “acquired yield”, 


Despite the problems involved in calculating “yield”, the simple 
approaches mentioned above will be presented since the concept of 
“yield” or “output” is important. As has already been mentioned in 
Chapter 1, what is reported here are the yields of specific target pop- . 
ulations, To obtain a measure of the “total yield” of a school sys- 
tem, the achievement of all those dropping out of school has to be 
measured as they drop out and in some way brought into a single 
measure. A longitudinal approach could also be adopted. 

The yield of students in Population 3a will be examined first, 
followed by that of the total pre-university year (Populations ga and 
sb combined) ahd finally the yield of 1 g-year-olds will be compared 
with the pre-university yields in each country. 
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Population 3a 


Figure 5.3 represents the yield diagrammatically by plotting aie = 
mulative percentile frequencies for each country against the PEP 
tion of an age group still retained in the terminal cathe’ th 
science programme. These distributions have been smoothed lg! = 
cally. From Figure 5.3 it can be observed that it is Sweden, as 
United States, Australia and Japan which have the highest yle me 
despite the fact that in the first three countries the average pete 
were relatively low. Obviously, yield is, to a certain extent, a east 
tion of retentivity, but only to a certain extent. The United Sta = 
Yield is obviously smaller than those of Sweden and Australia, 
though the United States’ retentivity is higher. : = ute 
It is interesting to note that in some countries there is a co in 
ently higher performance over the whole range of students pae 
others (e.g. Japan as compared with Finland). The United A 
students at the lower and of the distribution perform less well tha 


-m relativel 
the Swedish students. French and English students perform relati y 
well at the top end of the distribution. 


Population 3a and 3b 


Although it is only Population ga which can be regarded Ey E 
mathematical “fruits” or “end-products” of a system of eona e 
is also of interest to examine the yield of Populations 3a and 3 till 
gether, since this comprises the total proportion of an age group 2 up 
in full-time schooling. What the yield would be of a total age posse! 
is a matter of pure speculation, since in this study no effort V m 
made to measure the mathematics performance of those students i 
part-time education (and here the proportions of an age En 
part-time schooling, whether compulsory or voluntary, differ ¢ 
siderably from country to country) 
group not receiving an 
there is a small prop 
versity mathematics 
Colleges, but such s 


or those young people of the ef 
y form of schooling. For example, im ape 
ortion of an age group which studies ae 
at Colleges of Further Education or eset 
tudents were excluded from the target popula 
tion. In the Federal Republic of Germany a considerable porai 
of young people attend Berufschulen and continue the study E 
mathematics there, Again, these students were excluded from the = 
get population, since they were not in full-time schooling. Thus, thi 
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Fig. 5.3.Cumulative Percentile Frequencies (Smoothed) 
(Population 3 a) 


United States 


Percentage of age-group'exceeding score 


Score 


Percentage of age-group exceeding score 


“yield” examined here is simply that of all pre-university students 


in the target populations. 

Table 5.7 presents for each country the peer POPAN GONE p 
Populations ga; gb and 1b along with the proportion of the age 
group still retained in school for each of these populations. 


6 — 671266 Postlethwaite ga 


Table 5.7. Total mathematics score and proportion of age group in school. 
(Populations 1b, 3a and 3b) 


i b 
Population 1b Population 3a Population 3 
— —«$—__ 
ee P ortion 
Country Mean Proportion Mean Proportion Mean Propi 
9 
Belgium 30.4 100 34.6 4 24.2 k 
England 23.8 100 35.2 5 21-4 
Fed. Rep. 65 
of Germany 25.4 100 28.8 4-7 27-7 3 
Finland* 16.1 100 25.3 7 22.5 49 
Japan 31.2 100 31.4 8 25.3 726 
Scotland 22.3 100 25.5 5-4 a 2 
Sweden 15.3 100 27.3 16 12. sf 
U.S.A. 17.8 100 13.8 18 8.3 
ields) were 
* Although the mean for Finland is given as 16.1 the scaled means (and yields) 
calculated 


on uncorrected Finnish data where the mean was 26.4. 


However, since Test 5 Was common to both Populations 3a ome 
it was possible to estimate? what the 3a students would have ee i 
on the gb tests had they performed in the same way as they di b 
Test 5. Furthermore, since Test 3 was common to Ropa Ra E 
and 1b, it was possible to estimate what 1b students would 


* A regression Procedure 
(ts) from the total level 1 
estimated Ta on the 3b sca 


. score 
was used for each country to predict a sie he an 
b score (Ty,) and then predicting from that ts 
le, The two regression equations were: 


=a +b Try 
and Esr =a + bzta 
which combine to give 


Ty =at abst bibs Tas 

DH — la 
where h= Tor (Sts) (= sau] 

NE Typ - (Z Tio) 

a=b Ty, 

; NZ ts Tay — (Ets) (Z Tap) 

= DS dav — (2h) (Z Tso) 

4 NER- (Œh) 

as= Tas —b3 1, 


The same procedure was used for reducing the ga to gb score. 
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Table 5.8. Correlations of tests 5 and 3 with total mathematics score. 


Population 3b 
Population 3a ————__~ Population 1b 
Country Test 5 Test 5 Test 3 Test 3 
ee 


U.S.A. “gt 86 go 79 
Japan «90 94 «91 +90 
Sweden 86 73, 80 78 
Scotland 82 87 88 87 
Finland* 84 85 84 78 
Belgium 86 86 85 85 
England 88 87 88 +90 
Fed. Rep. 

of Germany -78 80 -79 82 
All Countries 89 92 „91 .86 


* These correlations were calculated on the uncorrected Finnish data. 
scored on the gb tests had they performed in the same way as they 
did on Test 33 However, it must be remembered that the content 
of ga and gb tests differed considerably from Test 5 and also the 
content of the gb and ıb tests from Test 3, as can be seen in the 
Appendix to Volume II of Husén et al. (1967); this accounts for the 
differences between Table 5-7 and Figure 5-4, where scaled means 
are given, 

Table 5.8 presents the product moment correlation coefficients 
between the Total Mathematics Scores (corrected) and Test 5 and 
Test 3 scores (as the case may be) for each population in each coun- 
try. The Total Mathematics Score included the Test 5 (or 3) scores 
and hence the correlations are higher than if it were Test 5 (or 3) 
Scores correlated with the Total Mathematics Score minus Test 5 
(or 3). 

Figure 5.4 presents the diagrams O 
3a, gb and 1b against the proportion of an age group still in school 


for each of these populations. Each diagram is made up of three 
parts as follows. The base of each diagram consists of the 1b popu- 
lation (where 100 percent of an age group is estimated to be in full- 
time schooling); the proportion of an age group is shown on the 
horizontal axis and the scaled mean score on the vertical axis. A 
Similar procedure is used for the 3b population and for the 3a popu- 
lation shown at the right side of each diagram. 


f scaled means for Populations 
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Fig. 5.4. Combined Yield (ga+ 36 on rb) 
(Regression Scaling of 3a+1b on to 3b) 
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In Figure 5-4 the effect o 


an 
f retentivity on yield can be seen. Jap 
has a particularly large yi 


red 
eld. It should, however, be remembe 


ool between Populations 1 and 3. — 
te a yield coefficient for each popu me 
mean (or ordinary mean) by the Po ee 
. The percentage of an age group in s (he 
estimated to be 100% in each country. 


It is possible to calcula 
by multiplying the scaled 
of an age group in school 
for the 1b Population is 
combined yield of the 


i icients are 
coefficients for Populations ga and gb. These yield coefficien 


ed means are given in Table A.4 in the 


Table 5.9. Yield coefficients. 


On scaled means On ordinary means 

Country 1b ga 3b gat+3b 1b ga gb g3a+g3b 
U.S.A. 304 352 449 801 178 2484 4316 6800 
pa 894 320 1243 1563 312 2512 12397 14909 
ne 285 494 89 583 153 4368 882 5250 
anand 515 188 263 451 223 1377 2608 3985 
ee 779* 232 157 389 161 1771 1575 3346 

elgium 1012 152 219 371 304 1384 2178 3562 


England 660 198 155 353 238 1760 1498 3258 


Fed. Rep. 


of Germany 1215 158 180 338 254 1354 1800 3154 


n the uncorrected Finnish data. It has not 


* 
The scaled means were calculated o 
ling analyses since the mistake in the Finnish 


been possible to rerun the regression sca 
data was discovered. 


The rank correlations between the scaled mean yield coefficients 
and the ordinary mean yield coefficients are .79, -91, 1.0 and .98 for 
1b, ga, gb and ga plus 3b respectively. The correlations indicate that 
there is a high degree of relationship between the two types of means 
used to calculate the yield coefficients. In terms of the pre-university 
yield (ga+ 3b) it is worthy of note that although the United States 
has three times as many pupils as Sweden enrolled in the pre-univer- 
Sity year, its yield is only 25 percent greater. Again, Japan has just 
Over twice as many pupils as Sweden enrolled in the pre-university 
year, but has a yield nearly three times as great. 

It is of particular interest, when considering yield, to compare the 
yield of the 1b population with the pre-university yields. Since the 
19-year-old grade group was the last point in all the school systems 
where 100 percent of an age group was still in school, it can be con- 
sidered as a comparable point near to the end of compulsory school- 
ing, and the yields as fairly representative of the outcomes of the 
compulsory schooling in each country. At the same time, it must be 
realised that the actual age of ending compulsory schooling differs 
from system to system and that some countries will obviously increase 
this yield before the end of compulsory schooling. 

It seems likely, for example, that, in those countries where compul- 
sory schooling does not end until the age of sixteen, certain topics 
which are considered to be difficult may be postponed until the age 
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of fifteen, while in those countries where compulsory ss, 
ishes at fourteen years of age, these topics may be = ja 
thirteen years of age. It might have been better to use Popula logical 
instead of 1b for these yields, since this is a strictly pate ae 
group, but as pointed out earlier in this chapter, this = wk 
provided results for seven countries only, since Germany ec pe Bs 
Population 1a, Therefore, despite the limitations involved, 
decided to use Population 1b, ields is 
The rank correlation between the 1b yields and ga+3b yi here, 
~°.56. Germany and Belgium are particularly worthy of er and 
since from the 1b yield to the a+ 3b yields they move from E 
second places to last and 6th respectively. Only the Unite ‘apt 
Japan and Sweden have relatively higher yields at the Bees aba 
level than at the 1b level and this is obviously, to a certain ee 
function of the size of retentivity. It would seem that the less r 


e 
z ; knowledg 
tive systems lose a great deal of potential mathematical kn 

in their countries, 


amount of talent. 
Populations ga an 


and, at the same time must also lose a fos 
The rank correlation between yields en ue 
d 3b (separately) and the measures of socia 6 and 
given in Chapter 3 of Volume II of Husén et al. (1967) are + ee the 
+.56. (The measures of social bias are repeated in Table A.5 1 
Appendix to this book), ively re- 
Thus it can be seen that the pre-university yield is negative ca 
lated to the ib yield, but is Positively related to social bias crate 
is in turn related to the age at which selection takes place (see ps 
et al., 1967). At the same time, we know that yield is, to a certain as 
tent, a function of retentivity and retentivity is related to the ee 
centage of pupils in Population 1a in comprehensive schools ‘he 
P. 67). It would seem that in countries with higher yields at ity 
pre-university level, there is a philosophy of equality of gain. 
in that selection is delayed or abolished, comprehensive schoo ee 
more common and more pupils from lower social status families 
tinue through to the end of secondary schooling. ible 
These organizational features, however, are not alone mespons 
for high yields, as scen by the difference between the United States’, 


4 i : other 
Japanese and Swedish yields. The curriculum, teaching and 

® Social bias is an index 
Position of one group to 
It can be reasonably ass 
socio-economic distributi, 
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i ic com- 
of the degree of difference of the socio-economic ee 
another, in this case Population 1a te 3a and za t a 

umed that Populations 1a and 1b have nearly ideni 
ions, 


family background characteristics are the most likely factors to ac- 
count for other differences (see Chapter 6 of Volume II in Husén et 
al., 1967). 

Although some factors associated with yield have been examined, 
no mention of the relationship between this yield “acquired” by the 
systems and the yield “required” by a society has been made, since it 
is not known. Research similar to that carried out by Dahllof (1963) 
would have to be undertaken where different branches of society re- 
ceiving students from school could estimate the amount of knowl- 
udents in a particular subject, and 
where, at the same time, approximations could be made of the pro- 
portion of any one age group entering work in that branch of soci- 
ety. In this way, it would be possible to estimate the “required” 
yield. Yield, as discussed in this chapter, has been based on Total 
Mathematics Score; it would, of course, be possible to discuss yield in 
terms of particular topics in mathematics and clusters of topics. By 
comparing “required” with “acquired” yield, it would be possible 
to examine how well the schools prepare their students to meet the 
needs of the society. This is not to imply that a school system should 
be based on a purely utilitarian philosophy; it should, of course, 
have much wider aims. Nevertheless, one of its basic tasks should be 
to meet the needs of the society. At present, however, the only sys- 
tem, to the author’s knowledge, where this problem of “required” 
yield has begun to be examined empirically is Sweden. In other 
countries, there is only intuitive knowledge of what society requires. 

Although it is possible to obtain ratings of the amount and type of 
mathematical knowledge required by various sectors of the society 
(including the university) receiving students straight from school, the 


problem becomes difficult when prediction in terms of manpower 


requirements with certain mathematical competences 1s attempted 
—the concept of “fit”. This is so because, in the economist’s lan- 
guage, “demand” is never a fixed amount but rather a schedule. 
Furthermore, the principle of substitution operates so that to some 
extent x “poorer” mathematicians can be substituted for y “better” 
mathematicians. Thus, the question becomes that of how many 
mathematicians are desired at each alternative price per unit. Added 
to this is the problem of predicting future demands. What is self- 
evident is that-in the application of the concept of “fit” an inter- 


disciplinary attack is required. 


edge they require from these st 
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Summary A 
It has been shown, by a discussion of the relationship be ks 
tentivity and type of school system, how the traditional ae hes 2 
tem, involving selection into an academic secondary schoo ee self- 
lower rate of retentivity than the United States system with i ia 
contained establishments which have been continually epar 
satisfy the educational needs of the community. However, in al 
of the European countries at present, policies nE per 
structure are being revised, and in Sweden, for example, th vised 
centage of seventeen-year-olds proceeding to gymnasiet i 
from ten to 28 percent from 1950 to 1964 (Dahllöf et al., 196 i 
The percentage of an age sroup in both the pre-university zes aie 
tics programmes in the twelve county 


various countries and th 
examinations of the pre- 
with retentivity: an exa 


€ correlations obtained were high. bee 
university Scores were made in ane 
mination of average performance of a 
» an examination of the performance of the var ee 
ernational standards and an ign 
the “yield” (how many are brought how far) of the various Pe ae 
tions. Variations among the pre-university populations in such c 


are 3 ne 2 subjects 
acteristics as age, social class composition and number of subj 
studied are pointed out. 


ies 
as untrie 
The examination of average performance shows that co 
which retain Jar 


ae 
Ser percentages of an age group to the p wie 
sity stage produce on average lower standards of ge gene of 
do countries retaining smaller percentages. However, the vanes 
Scores was not related to retentivity, although this would have 
expected. r ional 
In the examination of performance at various fixed E 
standards it becomes clear that although the average score may re 
when a higher proportion of an age group goes tirona 3 ape sed 
university year, the performance of the best students Ga terms o ane 
Proportion of a year group reaching various pee pe oi re 
levels) does not necessarily deteriorate. In other words, an ee 
intake into the pre-university year does not RECESSAtLy Souse a : A 
in the levels of achievement of the best students. This finding A 
particular importance in the light of the fears of many a es 
argue that if more and hence poorer students are allowed through, 
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the standards of performance will deteriorate and the learning of 
the better students will suffer. 

Since this is the case, it is interesting to proceed to an examination 
of the “yields” (how many are brought how far) in mathematics of 
the pre-university populations in the eight countries which had 
Scores for both Populations 3a and 3b. “Yield” takes into account 
the differing proportions of an age group in these populations in the 
different countries, whereas a comparison of average performances 
of pre-university year students in different countries does not. A dia- 
grammatic presentation of “yield” for Population ga is given, and 
this is also given in terms of “yield coefficients” (calculated on 
scaled mean scores as well as ordinary mean scores) for both Popula- 
tions ga and gb. In general, systems with higher retentivity have 
Sreater yields, but yield is, to a certain extent, a function of retentiv- 
ity. Curriculum, student motivation and other factors also would 
Seem to play some part in accounting for other differences in perfor- 
mance. It would seem that further research is needed to explore these 
issues, The relationship between Population 1b yields and the pre- 
university yields was negative and is mainly, but mae entirely, due to 
the varying retentivity through to the pre-university year. It would 
Seem that in some countries, particularly Germany and Belgium, a 
great deal of talent drops out of regular full-time schooling. This is, 
in turn, related to the selection process in some countries and results 
in bias in the social status composition of the students in the pre- 
university years in favour of the higher social staros groups The 
data obtained in this study reveal clearly the possibility of having 
both a high overall yield and an undiminished élite yield. i 

Although the concept of “yield” or “output” introduced is some- 
What crude, it is an important one and it is to be hoped that its con- 
ceptualisation and operationalisation will be pursued, and that it 
can be so refined in the future to produce detailed measures of “ac 
quired” yield in many subject areas. Measurement of “egre 
yield has already been begun in some areas. When progress is made 
in the measurement of the types of yield—that produced by the 
school system and that required by society—it will be possible © 
compare them and although the concept of “required yield” has its 
difficulties, the whole notion of “fit” may provide the schools (and 
educational policy makers) with more insight into the ways and 
means of catering for the needs of society. 
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CHAPTER 6 


Differentiation 


Three different aspects of differentiation will be acme a 
chapter in the light of the data available from the IEA stu y. S 
focus will be on the range of performance in systems employing v an 
ing modes of differentiation. In terms of inter-school grouping, A $ 
countries have a selective system whereby the more able cay a 
particular age are separated from the main body of students an ae 
into selective-academic schools; other countries have a comprehensi s 
system in which all students are kept in one school type until A 

of compulsory schooling or until the end of secondary schooli 2 
This is what is meant by differentiating or not ee 
different school types, and is sometimes referred to as ilar 
differentiation (cf, Husén, 1962 a, and Yates, 1966). An cumin 
will be made of the range of mathematics scores of students in * 
grade where most 13-year-olds are to be found (Population 1b) E 
comprehensive and in selective systems of education. In addition, a : 
is intra-school grouping, which concerns the grouping of studen i 
within schools—sometimes referred to as educational ageri 
tion. Some countries have a system of grouping students by grade 


3 : : in stand- 
with promotion taking place on the achievement of a certain st 
ard; other countries 


is often a sizeable pr 
in which most of the 
age. The amount of 


whereby students are split into different 
n the basis of measured or judged ability 


a a oes, . ies a 
and/or achievement, The extent to which this is carried out varie 


go 


reat deal from country to country. This is the third aspect of differ- 
€ntiation to be considered in this chapter and will involve an ex- 
amination of the range of mathematics scores of students in Popula- 
tion 1b from countries where ability grouping is practised to a great 
extent and from those countries where it is practised either to a small 
€xtent or not at all. 

A great deal of research has been carried out on various aspects of 
differentiation and particularly into ability grouping. In recent years 
various summaries of the research carried out have been made (cf. 
Ekstrém, 1961, Goldberg et al., 1966 and Yates, 1966) and these 
include all of the research studies which are relevant to the three 
aspects of differentiation described above. Most of the research so 
far carried out can only bear very peripherally on the problems 
under discussion here, and the directly relevant (in that the standard 
deviation scores have been used as a criterion) studies are very few 
indeed. Svensson (1962) carried out a five-year follow-up study where 
he compared the performance of students under a comprehensive 
System of education and students under a selective system of educa- 
tion in the City of Stockholm from 1955-59: His findings were that 
by the age of fifteen, “good” students performed at about the same 
level whether in the selective-academic school (realskolan) or in the 
Comprehensive school (grundskolan), whereas “poor” students per- 
formed better in the comprehensive school than in the remainder 
School (folkskolan). Although Svensson did not specifically compare 
Standard deviations, the implication is that the standard deviation is 
Smaller in the comprehensive than in the selective system (when the 
Performances of students in different schools are combined). In an 
article by Husén and Svensson (1959) and from certain findings in 


Chapter sn et al. (1967), the same implications 
ae arcuate a although it does not 


are apparent, There is other research which, : seat 
compare selective and comprehensive systems, shows how s a K g 
influences the standard deviation within a school ne : oug = 
(1964), has followed the complete population born in dhe a weel 

of March, 1946, right through their school careers; this follow-up i 
Still continuing. It became apparent that when ea were bai 

Or assessed on the basis of ability for placement into higher or lower 


ee a i 
academic groups (whether this was within schools o eaea 
Schools), those who entered the higher academic groups V 

i groups and these students 


f . 
requently from the higher social status 
gl 


continued to improve; on the other hand, those who went 
into the poorer groups were often from the lower social status 
groups and their performance over a period of time deteri- 
orated relative to the higher social group. Even when children 
at age 8 had the same score, it was the middle social status group 
children who tended to be put into the higher group, while the lower 
social group children were placed in the lower group. Certain analy- 
ses which appeared in the Robbins Report (1963) are a follow-up of 
the information in Douglas’ book and indicated that the trend which 
he had already detected up to the age of 11 continued for students 
going on to 15 and 18. Pidgeon (1959) has shown in a national sur- 
vey of attainment in mechanical arithmetic the percentage of mod- 
ern school and all age school children scoring above the grammar 
school mean was 22% at age 14, i.e., that despite selection at age 11, 
there was still a very big overlap of scores between the secondary 
academic school students and the remainder of the students. This 
may well reflect the limited range of the content of the tests, but on 
the other hand, it may be indicative of different rates of develop- 
ment in the whole range of children, with the result that the modern 
school does not necessarily possess the weaker children at all levels. 
Since grouping between schools by ability/achievement is based on 
the same Principle as streaming, it seems reasonable to infer that se- 
lective systems which also practise streaming will have the largest 
standard deviations of all Systems. Pidgeon (1962) examined the con- 
cepts of streaming versus non-streaming and grade promotion versus 
age promotion in terms of the standard deviation of 13-year-olds in 
twelve countries. It is clear from Pidgeon’s data that selective systems 
do not necessarily have larger standard deviations than comprehen- 
Sive systems, but it must be remembered that this study was carried 


a on 13-year-old samples of students, the representativeness of 
which was unknown, 


A number of other studies h 


ave questioned certain aspects of inter- 
school grouping’ based on di 


fferences in ability and attainments. 
Yates and Pidgeon (1957), Emmett (1945), Daniels (1959) and others 
in Britain, as well as Hitpass (1960) and Undeutsch (1960) in the 
Federal Republic of Germany have shown that even the best avail- 
able methods of allocation involve errors of placement with regard to 
at least ten percent of the children concerned. Pedley (1963) and 
Dancy (1963) in Britain have shown that students who would not 
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normally have entered grammar schools have proved capable of 
grammar school type success from comprehensive or independent 
Schools. The fact that this is remarked upon indicates that there is 
thought to be a gap and the implication is that if all were educated 
together the gap (and hence the standard deviation) would be 
smaller. This reinforces the view that educational systems practising 
iter-school grouping are expected to have larger standard deviations 
than countries not practising it. 

As far as age promotion versus grade promotion is concerned, 
there is no known research. Belgium, in its official statistics 
(1960-61), has published a table revealing the progressive increase in 
the incidence of backwardness as children move through successive 
Srades, 


Sag Ist and grd 4th 5th 
i, of students of normal age or above 84 77 74 71 69 
ndex of school backwardness 24 35 41 45 47 


An index of the amount of grade repeating and grade advancement 


m any country will be the size of the standard deviation of age of 
Students in Population ı b. These are given in Table 6.1. As can be 
seen, England, Japan and Sweden have the smallest standard devia- 
tions, while the Netherlands and Belgium have the largest. In Eng- 


land, a system of grades (known as “standards”) used to operate, but 
has largely been abandoned in favour of what is sometimes known as 
horizontal grouping, which involves promotion by chronological age. 
Ta Sweden, chronological age is the basic criterion of grouping, al- 
though a certain amount of grouping based on subject-ability also 
took place from Grade 7 onwards. In most of the other European 
Countries, however, and in the United States, some form of grading 


'S practised. In Israel, on the other hand, the general practice of 
j to repeat a grade was recently 


allowi : 

“Owing (or requiring) a slow student i 

discontinued and teachers are now asked to restrict a 

fo tw United States, more radica 
O percent ir students. In the é : 

3 apt es are being tried, and 


departure f grading 
s from the normal type of grac" > p 
these are lucidly described in Goodlad and Anderson (1963) and in 


asmussen 

and Prete (1962). ` Fi: 
_ A great deal of research exists on the form of SS baie 
tiation involving streaming or ability grouping: Firstly, it mus be 
Tealised that differentiating by ability either between or within 
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Table 6.1. Means, standard deviations and N’s of total mathematics score 
and standard deviations of age in months. 


(Population 1b) 


Total mathematics score 


——— ey Age 
Country M S.D. N S.D. 
Australia 18.88 12.28 3079 7-7 
Belgium 30.43 13.75 2644 8.8 
England 23.76 18.53 3148 4-2 
Fed. Rep. 

of Germany 25.45 11.70 4476 6.6 
Finland 16.13 11.61 1325 6.66 
France 20.96 13.23 344 78 
Israel 32.29 14.67 3232 5.6 
Japan 31.16 16.90 2050 3-4 
Netherlands 21.43 12.12 1444 11.6 
Scotland 22.31 15.69 5718 5-4 
Sweden 15.26 10.83 2808 4:9 
U.S.A. 17.85 13.21 6544 6.8 


schools is based on the same principle, and therefore much of 
the research already mentioned concerning inter-school grouping a8 
relevant also to the problem of intra-school grouping. Yates (1966) 
has abstracted about 40 researches dealing with aspects of homoge- 
neous grouping, which had been undertaken between 1932 and 1965- 
It is interesting to note that whereas the research into inter-school 
grouping, although sparse, has been fairly conclusive, the research 


into intra-school grouping, although plentiful, has been conflicting. 
Passow (1962) has described some of tH 


he discrepancies in the research 
so far undertaken which may 


oka well account for these apparent contra- 
dictions. The general findings of comparisons of homogeneous and 
heterogeneous Sroups or of streamed and unstreamed groups have 
mainly concentrated on differences in mean scores between the 
groups. However, from the work of Blandford (1958), Rudd (1958), 
Khan (1954), Gatfield (1958) and Daniels (1961) in Britain, one Te 
sult of the comparisons, which is relevant to the present discussion, 
was “The dispersion of the various test results was greater in the 
streamed than in the unstreamed schools.” (Yates, 1966, page 63.) 
This is to be expected, since in a heterogeneous group the teacher is 
likely to teach to a mean level with the result that the variance of 
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scores wi : . 
will become less, whereas if a group is split into “n” homoge- 


neo} 

ae — then the variance of the group as a whole will in- 

ti A idgeon (1962) has suggested that much of this is bound up 
eacher expectation and student role fulfillment. If streaming 


take : s 
s place and a group is split on the basis of ability and achieve- 


ment i 3 
nto three sub-groups—an A class, a B class and a C class— 


t 
ie a the A group will expect that group to do well; 
9: The net t — will expect to do well; they will in fact do 
ee. 2 ord will be true for the C class. Thus, the variance will 
| aaa = gy it is clear that the earlier this process of 
Piles” o in a school, the more the variance will increase as 
Robbins es through the school (cf. Douglas, 1964, and the 
ene eport, Appendiz I, pp. 46-52). no phenomenon also 
ieee teachers philosophy concerning the ‘capacity theory of 
rable meee assumption that every child has a limited and meas- 
e ility—since streaming tends to make this a self-fulfilling 
phecy. 
en a year group setting (the grou 
or activities only according to t 
ng in increasing 
nt criterion. 
ts of differentiation in terms 


iping of students for specific 
heir ability or achievement) 
the spread of 


will a 
Score have similar effects to streami 
S : 
of the age group on any achieveme 


Li 
of nA us now examine these three aspec 
he data available from the IEA study for Population 1b (and 1a 


whe r a 
al appropriate). Population ib has been selected for detailed ex- 
Nation, since it is a grade population within the limits of com- 


Pulso; 7 
ry school attendance in all countries. 


a ee of the standard deviations © es of a grad 
ae zom systems of education organizational dit- 
a of different extents Wi y involve taking into 
the an amount of retardation (grad etc.) in each of 
tion of = (although this is already Over 
Presents € second aspect of differentiation). : ss 
dents fo not only the mean, standard deviation an number of stu- 
ation ET Population 1b in each country, but also the standard devi- 
ean age of this population, since this can serve as an index of 

ation in the system. (A full presentation of the means, standard 


e-repeating; 
lapping with the 
Table 6.1, therefore, 


examina- 
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Fig. 6.1. Standard Deviations of Mathematics Scores for rb Populations 


Aus Bel Eng Fin! France Ger 


USA 


ble 6.1. 
1 The unweighted standard deviation for Finland is 11.61—see page 6 and also Ta 


deviations and numbers of students of Total Mathematics ar 
Lower Mental Process and Higher Mental Process by sub-samp 
appears in Table A.6 of the Appendix). res 
Figure 6.1 presents the standard deviations of mathematics sco 
diagrammatically, h 
From the presentation of the school structures in Chapter 4, it can 
be seen that Australia, Japan, Sweden and the United States cay on 
the whole, be placed in the theoretically non inter-school E 
tiation category, whereas the other countries have various degrees w 
inter-school differentiation. On examining Figure 6.1, it is apimi 
that factors other than just inter-school differentiation are associate 
with the different sizes of the standard deviations. It is perhaps 
worth noting that the average standard deviation for differentiating 
countries is 19.65 and for non differentiating 13.33 (p<.01)- rA 
ever, it is obviously necessary to examine this in more detail. It 1 
possible to split the countries into three groups: (1) those where S 
standard deviation is greater than 15.5 (2) those between 12-5 ot 
15-5 and (3) those under 12.5. In the first group are England, whic j 
has a selective academic system, Japan, which has a non-differet- 
tiated system, and Scotland, with a sizeable number of comprehen 
sive schools. The standard deviation for England is significantly 
larger than that for Japan and that for Japan larger than that m : 
Scotland. It was expected that England would have the largest stan 
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ard Fatt ; : z - t 
deviation, since it practises not only inter- but also intra-school 


er (streaming). Japan is a paradox—a system of mass 
Zon. exists (57 percent of an age group still in school in the 
nee year), but although a junior high school and senior 
i C hool. structure exists, it would appear that within these groups 
ne is a hierarchy of schools (King, 1965) and there is severe compe- 
tition among students to get into the best schools. This in itself al- 
Teady indicates a very severe form of inter-school differentiation with 
the best schools taking the best students and the poor schools having 
the poor students; this is likely to create a wider spread of scores than 
ge heol differentiation alone as practised in England without 

eaming. The gaps between the blocks of schools in England will be 
Considerable, but the total range of between school differences is 


likely to be less than in Japan. At the same time, there is very little 

Spr: ithi : i . 

pread within Japanese schools, since it would appear (from discus- 
otivation for learning is im- 


Sions with Japanese educators) that ™ 

Posed by the teachers and that there is little in the way of structured 
content with motivation inherent in the learning situation. Thus, it 
Seems possible that it is the hierarchy of schools which is associated 
with a wide spread in this case. (It would be possible to check this by 


a . 
between-schools analysis). Scotland, although having more than 
hensive, practises a high de- 


half š 

alf of its schools designated as compre: 

Sree of streaming within schools. At the same time, there are many 
Small schools at the primary level which would tend to produce a 


ao spread of scores. 
the second group are Israel, 
France. Israel ue endl population of wide ethnic background, 
often coming from countries with widely differing standards of edu- 
cation; in other words, the population was very heterogeneous and 
One of Israel’s policies has been to try tO homogenise the school pop- 
ulation more and reduce the spread of scores (cf. P- 31): 
On the other hand, all students who had immigrated to Israel 
after 1957 were exiluded from the testing 5° that it could be argued 
that a smaller standard deviation might have been expected. As part 
of the homogenising policy an eight year elementary school now ex- 
Sts with transfer to secondary school taking place at the age of four- 


i 
teen. Belgium and France, on the other hand, have the traditional 
3 without streaming, but 


Euro or 
uropean type of inter-school differentiation, i 
with grade repeating, both to a considerable degree. The United 


Belgium, the United States and 
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7- 
671266 Postlethwaite 


States, although not possessing de jure inter-school SE s 
the junior high school level, has de facto: a certain enun a aio 
in the form of segregated schools in some areas; furthermore, ene 
grouping and enrichment programs are fairly ier ee pihi: 
representative sample of Junior High Schools 66% o a Pi 
pals said that in their schools ability grouping was practi 
sally or generally—Husén et al., 1967). TO Gomes 
Again, in the United States, students attend a schoo. ae Be 
they live; since families of similar socio-economic status ten pe de 
together, this has a homogenising effect on the schools in p 
areas, e.g. suburbs, slums, etc. i . 
In ae third group are the Netherlands, Australia, the Saen 
public of Germany, Sweden and Finland. The Netherlands pra A 
inter-school differentiation but differs from the other oe jà 
lective systems represented in this study in that it is a system wa a 
middle school. Definitive transfer to the academic-selective or i 
university school is not made at the end of the primary school eo i. 
but is deferred until the age of fourteen. The intervening et Ws . 
spent in a common secondary school. However, grade nee 
practised in the Netherlands to a greater extent than in any yr 1) 
system in this study (see standard deviations of age in Table 6. : 
Australia, although having a more or less comprehensive system ni 
education, practises grade repeating and also ability grouping oa 
Table 6.3). Germany (and it must be reemphasized that the seats 
representing Germany come from only two of its Linder—Hesse 


$ Š 3 E ithin 
and Schleswig Holstein) has inter-school differentiation, no W 
school differentiation and a certain amou 


den has officially neither inter- 
level (7 årskurs), although som 
place in Grade 8 and following 


nt of grade repeating. Swe 
or intra-school differentiation at this 
e within school differentiation pae 
grades. Finland practises inter-schoo. 


: sc p F in Table 
differentiation, a certain amount of grade repeating (rank 5 in Ta 
6.1) and intra-school differentiation. 


The above brief descriptions have serv 


ae nie the 
have attempted to Supply qualitative descriptions of not only Ai 
inter-school differentiation which takes place, but also of the pen 
school differentiation in terms of both grade repeating and ability 


3 : . s A we r in 
grouping or streaming, which will be examined emprirically later 
this chapter. 


Unfortunately, 


ed two purposes. First, they 


: wae «hae ol 
it has not been possible to consider the inter-scho 
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ve measure of 


differentiati sa 
erentiation empirically because of lack of objecti 
place in each 


pene which inter-school differentiation takes 
CUTE it i poe be seen from the above description how diffi- 
school differenti 10 establish an index for the type of de facto inter- 
ie eee iation which exists, for example, in Japan. One pos- 
ied Sr me on which data exist would be the retentivity index 
analogous y _ 5 whereby high retentivity could be regarded as 
would plac x ittle inter-school differentiation. Unfortunately, this 
Sweden aa as having less inter-school differentiation than 
group cabrio is obviously untrue. [I£ the total percentage of an age 
school differ c 9 the pre-university year is used as an index of inter- 
Giceentinrs entiation (low retentivity equivalent ta high inter-school 
deviation a) the rank correlations between this and the standard 
ña — i mathematics scores for Populations 12 and 1b are .20 
aera 2 e omitted from 1 b—which does not 
laatan 2 common sense.] However, this measure has too many 
enad s to be used in further analysis. It is clear that in future 
desert onal educational research more thought must be devoted to 
iced ec measure for this elusive variable. The measures ob- 
limited, this study of grade repeating and ability grouping are less 


n—Grade Repeating 


yiations of Population ib stu- 
he standard deviations of 


Intra-School Differentiatio 


Tab 
le 6.1 presented the standard de 


enc 
ts 

age i Total Mathematics Scores and also t 
n each country which serves as an index of grade repeating. The 


hes between them is —-53+ indicating that the moe grade 
Supporte is practised, the narrow he spread of scores. This 
featur s the theory that when @ grade system öt promotion is a 
what i of the system of education, then teachers will tend to teach to 
Of sco miki judge to be a mean level, which tends to reduce the spread 
there es In age promotion systems, the spread will Bs wider, since 
own as be a tendency either to allow students to progress a mher 
TO through the various subject contents to be learned, or to 
This A ability grouping. 

tion ia r a interest to examine th 
ber of a le 6.2 presents the mean, 

ents of Total Mathematics Score 


er is t 


ng data for Popula- 
Jeviation and num- 


standard d 
for each country as well 


e correspondi 
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Table 6.2. Means, standard deviations and N’s of total mathematics score and standard 
deviations of age in months. 


(Population 1a) 


Total mathematics score Age 

—_—_—_— Age S.D. 

Country M S.D. N S.D. Gb) 
Australia 20.18 14.01 2916 3-5 TI 
Belgium 27-74 15.02 1686 3-3 8.8 
England 19.31 16.97 3012 3-3 42 
Finland? 15.39 10.76 1156 3-3 6.7 
France 18.32 12.37 2410 3-5 78 
Japan 31.16 16.90 2049 3-4 3-4 
Netherlands 23.86 15.91 428 3.1 11.6 
Scotland 19.05 14.64. 5256 3-5 54 
Sweden 15.70 10.81 2553 3-4 49 
U.S.A. 16.15 13.34 6231 3-5 68 


2 See note concerning Finnish data on page 6. 


as the standard deviation of age. The standard deviation of age for 
Population 1b is really a better index of the amount of grade repeat- 
ing practised, since Population 1a is a chronological population 
taken from across grades. Thus, the standard deviation of age for 
Population 1b is repeated in this table. (Table A.7 in the Appendix 
presents for Population 1a the means, standard deviations and num- 
ber of students for each country by sub-sample for Total Mathemat- 
ics Score, Higher Mental Process and Lower Mental Process.). 

The spread of mathematics scores in Japan, Sweden and the 
United States is much the same as for Population 1b. England and 
Scotland have small standard deviations and Australia, Belgium, Fin- 
land, France and the Netherlands have larger standard deviations. 
Although this indicates that where an age group is spread over 
grades its standard deviation is larger than when a grade group is 
spread over ages (again because the teacher is teaching to a grade 
level), it is still interesting to note that England (inter- and intra- 
school differentiation) and Japan (severe de facto inter-school differ- 
entiation) have the largest standard deviations. However, it is to be 
expected that the chronological population’s (1 a) standard deviation 
will be more strongly associated with the index of grade repeating 
that has been chosen than the standard deviation of the grade popu- 
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lation 
1b) ion i 
(1b). The correlation is —-5, which although negative is 
x3 in Population 1 b between the 


less 
a than the correlation of —.53 
hematics È en 
score and grade repeating. This supports the theory 
age group 


tha 

is ie ncn deviation will be larger where an 

Fite ia —_ than when a grade group has some other ages 

Be cite tices = e = arriving at any overall conclusioni let us also 

Ue momtot A a deviations in conjunction with measures of 
ility grouping practised in each of the systems. 


n—Ability Grouping 
ked to re- 


Intra-School Differentiatio 
Js in the sample was as 


Eact 
h school principal of the schoo 
he School Questionnaire: 


Spond 
to the following question on t 


To wh 
h: P 
ability e extent does educational differentiation (€-8- setting, streaming, 
ty: ouping) take place within your school? 
Aa 1s universally practised 3 
ik e generally practised 2 
s practised in some age OF grade groups only $ 
4 


It i i: 

a is practised at all 
omment 

s in the various countries, but al- 


national frame of the ques- 
as follows: 


our school? 


Thi 

s i 

Ways Aia asked in various way 
ed according to the above inter” 


tion. Th 
Th 5 i ‘ 
e United States phrased their question 


To wha 
hat extent does ability grouping take place within y 


a is practised for all pupils 
It is practised for some pupils at all levels 2 
practised in some age or grade groups only 3 
“Comment’) 
4 


Indi z 
(Indicate in which groups under 


It is 
not practiced 
at all 
Comment 


the Fy, 
€ French as follows: 
e numéro COT- 


Da: 
Ns qu 
elle . ion ! ez | 
Yr mesu: A lection + entour 
Sspondant) re pratiquez-vous la sél ( 
Toujours 
Reman 
elatif } 
Ja tif à un certain âge © 
Don. mais 
nez 3 > 
les raisons de votre action 


Aom 


u à un certain niveau 


anq 
the English as follows: 
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To what extent does educational differentiation (e.g. setting, streaming, 


ability grouping) take place in your school? 
It is universally practised 
It is generally practised 
It is practised in some age groups only 
It is not practised at all 
It is practised in mathematics at all ages 
It is practised in mathematics in some age groups only 
It is practised in one or more other subjects at all ages 


It is practised in one or more other subjects in some age groups 


only 
Comment 


STOTT Bo WH 


Two indices were derived from the data. The first was a mean 
score based on the code 1-4 where a low number devotes ability 
grouping is practised a great deal and a high number means it is 
practised little or not at all. The second was the percentage of all 
school principals responding to either the first statement (universal) 
or the second (general). Table 6.3 presents these data for both Pop- 


ulations 1a and 1b. 


Since the first index is based on all of the responses and not just 
two as in the case of the second index, it is the first index which will 
be used. There is, of course, a very close similarity in the ranks. Some 


Table 6.3. Indices of the extent of ability grouping practised. 


Population 1a 


Population 1b 
Ability grouping eater 


Ability grouping 


a —_—_— Number —————— 
ntry (1) (2) of schools (1) (2) 
Australia 2.63 48 108 2.63 48 
Belgium 2.47 54 61 2.4.7 57 
England 2.12 64 184 2.03 64 
Fed. Rep. j 
of Germany — — -s 3.83 o 
Finland 4.0 o iI ie o 
France 3-0 45 125 3.02 20 
Israel — = Sasa. 3-44 2 
Japan 3.88 o 210 3.88 o 
Netherlands 3.14 9 88 3.11 10 
Scotland 1.75 77 73 g 1.73 78 
Sweden 2.69 36 80 2.69 34 
U.S.A. 2.19 62 395 2.21 66 
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Number 
of schools 


72 
61 
182 


161 
111 
124 
154 
210 
30 
73 
80 
395 


comment a 
coment onthe see appropriate Fn E e ano 
ever, especially since se an there is no ability grouping whatso- 
The United States : me inter-school differentiation is practised. 
More than one i = be hools seem to practise ability grouping much 
tie eure fa HIG 5 l have expected. Although there may have been 
been consistent ing in the responses, it is, however, unlikely to have 
volved. when one observes the number of the schools in- 
Sw i 
the ego sixth in the amount of ability grouping practised in 
intra-school i whole, although it must be remembered that no 
The Set tee erentiation officially took place until seventh grade. 
ity grouping i ea correlations between the extent to which abil- 
Total cee. pr actised in a system and the standard deviation of 
sult of the co oe Score is =89 and —.18 (the negative sign is a re- 
pouty dhe i de) for Populations 1 b and 1a respectively. This sup- 
ypothesis that by forming homogeneous groups of ability 


or achi 
chieveme ae 

ement within an overall age oF grade group, the overall 
us in its achievement than if it 


gro : 
create ecOme more heterogeneous i 
Extent to y aa difierenuano It is clear that the greater the 
standard de hich ability grouping 15 practised, the wider are the 
ine the na ations of scores. However, it is also important to exam- 
viation of ationship between ability group!"s and the standard de- 
Mathemati mathematics score when grade repeating and the mean 

atics score are held constant. 


Tab: 
le 6.4 presents for Populatio 


ard deviations of 


n 1a the stand 
the measure of 


ell as 


total 

al m š 

abilit athematics scores for each country as W' 

Y grouping, grade repeating and mean mathematics score. The 
noted that there is a sub- 


atfer dks 
a. Feya since it has already been 

Tables 6 elation between mean score and stan 
of Table in and 6.6 present the product-momen” con 
ability er 4 and the simple correlations and pn gyre 
Pied E grade repeating and car mat La Ci i a 
of Tab s with the criterion (standard deviation). The thir co! umn 
le 6.6 gives the contribution tO the total yariance (multiplied 


my. 100 
lt A oh each of the predictors. 
evident that ability groupin 


dard deviation. 
relation matrix 


weights? of 


rongly associated with large 


d by Cooley and 
Wiley, New York, 


g is St 
* The A g1 
Ohnes ihe regression procedure used was that reporte! 
» Multivari : : 
962, pp. E Procedures for the Behavioral Sciences, 
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Table 6.4. Standard deviations, measures of | ability grouping and grade 
repeating and mean mathematics scores. 
(Population 1a) 


S.D. Ability Grade 
of math. group- repeat- Mean score 

Country scores (1) ing (2) ing (3) math. (4) 
Australia 14.01 2.63 7-70 20.18 
Belgium 15.02 2.47 8.80 27-74 
England 16.97 2.12 4.20 19.931 
Finland 10.76 4.00 6.66 15.39 
France 12.37 3.00 7.80 18.32 
Japan 16.90 3.88 3-40 31.16 
Netherlands 15.91 3-14 11.60 23.86 
Scotland 14.64 1.75 5.40 19.05 
Sweden 10.81 2.69 4.90 15-70 
U.S.A. 13.34 2.19 6.80 16.15 
Grand Mean 14.07 2.79 6.73 20.69 
Grand s.p, 


2.26 0.73 2.42 4:79 


Table 6.5. Product moment correlation matrix of Table 6.4- 


a = eee ae 


x =.181 —.047 +726 
2 1.000 +039 265 
5 1.000 060 


Table 6,6, T, b and rb roo of Table 6.5. 


84 
—.181 - ge 
Grade repeating — .047 >s ee a nate 
Mean TMS (corr.) -726 ioe ie 


Total variance accounted for 


68.37 
Se ae ee 


tandard deviations in both Populations (the negative signs are ae 
onsequences of the Coding used). As expected, grade repeating 1$ 

ith small standard deviations in Population 1b (the 
grade population) but has Practically no association with the size of 


the standard deviation in Population 1a (the chronological popula- 


Ci 
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Table 6.7. Standard deviations, measures of ability grouping and grade 
repeating and mean mathematics scores. 
(Population 1b) 
ae 


Ability Grade Mean 
s.D. of math. group- repeat- score 
Country scores (1) ing (2) ing (3) math. (4) 
Australia 12.28 2.63 7.70 18.88 
Belgium 13-75 2.47 8.80 30.43 
England 18.53 2.13 4.20 23.76 
Fed. Rep. 
of Germany 11.70 3.83 6.60 25.45 
Finland 11.61 4.00 6.66 16.13 
France 13-23 3.02 7.80 20.96 
Israel 14.67 3-44 5.60 32.29 
Japan 16.90 3.88 3.40 31.16 
Netherlands 12.12 3.11 11.60 21.43 
Scotland 15-69 1.73 5.40 22.31 
Sweden 10.83 2.69 4.90 15.26 
TSA 13.21 2.21 6.80 17.85 
Grand Mean 13-71 2.93 6.62 22.99 
2.21 5.82 


Table 6.8. Product-moment correlation matrix of Table 6.7. 


=! See == 
I 1,000 —.294 — +535 544 
2 1.000 .OII «220 
3 1.000 —.164 

1.000 


tion, where students of the same age are spread across several grades). 
Again, as would be expected, the mean score contributes consider- 
ably to the variance since it was known that the distribution of the 
scores on the tests tended to be crowded towards the foot and open 


at the top. 

From other researches alread: the beginning of this 
chapter, there is evidencé concerning the effect of grouping practices 
on lower socioeconomic groups in some systems of education, but 
before proceeding to consider some of the implications of the results 


y mentioned at 
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Table 6.9. r, b and rb 100 of Table 6.8. 


r b rb 100 

R? = 0.670 
Ability grouping — 294 — .422 12.41 R = 0.819 
Grade repeating — .535 — 448 23.97 
Mean TMS (corr.) +544 -563 30.63 


Total variance accounted for 67.01 


ae aseetions 
presented in this chapter, it is well to reflect on certain et 
to the findings. First, there is no separation of setting from oe is 
grouping in the measure of ability grouping—thus the measu sure: 
impure. The measure of grade repeating is an inferred mes of 
Purer measures should in future be obtained, With a ee ais 
12 observations (in this case countries) a multiple regression = ie 
containing more than three predictors is inadvisable because © sige 
few remaining degrees of freedom. If we had more systems a this 
analysis—either more countries or sub-divisions of countries— 
analysis could be pushed much further, 


Implications 


k 3 f er e Euro- 
What are the educational implications of these findings? Som pore 

x meg , i 0 
pean countries are considering changing from a selective peg 
tem to a comprehensive system (e.g. England). Sweden has a 


s re- 
done so and about half of Scotland’s secondary schools are comp 


z 4 iminate 
hensive. It should be realised by policy makers that to elimi 
inter-school differentiation but 


to retain intraschool differentiation 
(ability grouping) will still mean a fairly large variability of ere 
ment, although perhaps not quite so large as before. The pie 
ability grouping within schools is exactly the same as that of ee 
school differentiation, Many teachers (Yates, 1966) believe in 7 
grouping and even though teachers or head teachers are in a deli i 
ate non-ability grouping school they will occasionally indulge gae 
subconsciously—for example, the head teacher who says: “Ah, es 
I have no streaming in my school; in this class X, for example, the i 
are pupils of very different ability, an absolutely kreragpuani 
group: the bright ones are over there on the right haad side, the no 
so bright in the middle, and the poor ones on the left.” In other 
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words, it is the philosophy of the teachers which it is important to 
change; it would be insufficient to take an administrative decision 
that there should be no more ability grouping in schools without also 
helping the teachers to change their outlook. This may be particu- 
larly difficult in countries such as England and Scotland, where the 
Capacity theory of intelligence is very prevalent, not only among 
teachers, but also among some educational policy makers (Pidgeon, 
1966). 

There is evidence (Svensson, 1962, and Husén, 1966) to indicate 
that “good” students are not held back by “poor” students when in 
the same school and, what is more important, that “poor” students 
improve when with “good” students, whereas when put into a ho- 
Mogeneous group they deteriorate. Thus, where differentiation is 
being practised at an early stage in the school system, it is the “cul- 
turally-disadvantaged” and/or lower ability child who suffers. In 
a sense, the practice of differentiation can exacerbate the plight of 
the culturally-disadvantaged child, since once differentiated into the 
“poor” ability group (either inter- or intra-school) he will, in rela- 
tion to his peers (age group) deteriorate—wide standard deviations 
—rather than improve—narrow standard deviations (cf. Robbins 
Report, Appendix 1). : 

The evidence provided in this chapter is based on differences be- 
tween educational systems, and it would seem that administrative 


decisions concerning both inter- and intra-school differentiation can 
affect the size of the standard deviation in mathematics scores. 
ther subject areas is a matter 


Whether the same would hold true ino : 
uld seem likely. Educational policy 


for future research, but it wo Lea 
facts when considering any changes 


makers should be aware of these 
in their school systems. 


Summary 


ps between three aspects of differentiation and the 
variability of mathematics scores ion the IEA tests are examined in 
the light of data from twelve different systems of education. The 
three aspects are G) inter-school differentiation, (2) intra-school dif- 
ferentiation (grade repeating) and (3) intra-school differentiation 
(ability grouping) After a discussion of relevant previous research, 
both at the international and national levels, an examination was 


The relationshi 
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opula- 

made of the standard deviations for Populations 1b and E ue inet 
tion 1b was chosen as the main focus of attention, guiness on thie 
grade still in compulsory schooling in all of ge med 
study. Interpretation of the size of the standar of INEren 
country was undertaken in terms of the three aspee inter-school dif- 
tion mentioned, Unfortunately, no suitable index of an orde in 
ferentiation exists, but it would seem that either aa fang with wide 
inter-school differentiation does tend to be associate 1 
standard deviations. S b was used as 4 

The standard deviation of age of Population A iri 1b that 
measure of grade repeating, and it was found in ole the standard 
the greater the degree of grade repeating the smale wras, a E 
deviation. However, the association in Population 1a 

ected, nearly zero. a schools 
. Specific dita were collected from the school sce poi i 
in the sample on the extent to which ability Broupine: w ble for all 
in their schools as a whole. The mean score on this ber the index 
schools in the target population within a country served or coun- 
of the extent to which ability grouping was practised. m f standard 
try. There was a correlation of about -25 between the size o. enctiel 
deviations and the extent to which ability grouping ke pe be- 

When grade repeating was partialled out of the nen: was 
tween standard deviation and ability grouping the corre: aie 
about .4. When ability grouping was partialled out of the = lation 
between standard deviation and grade repeating, the 1b oa 4 Heat 
correlation became about —4 and the 1a Population a lower 
zero. This indicated that grade repeating was associated with 2 


: there 
sais * ; : tion 1a 
standard deviation for Population 1b while for Popula 

Was no association, 


Differentiation into 
tion and intra-school 
8roups was found to 
Grading and grade re 
tions, Educational] P! 
ship between these e 
achievement tests in 
in the debate concer; 
education. Ability 
standard deviations 


i ntia- 
homogeneous groups (inter-school a dee 
differentiation—ability grouping) pa aon 
be associated with large standard are 
eating is associated with small energie i, 
olicy makers should be aware of fe menus OH 
ducational practices and the spread of s hae 
mathematics. This is of particular PENER D 
ning selective ne Sea pe ee o jai 

i ithin schools is 
ee RET kt boy even though that school sys- 
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tem may have no inter-school differentiation. Furthermore, it is not 
€nough to take an administrative decision concerning differentiation 
without, at the same time, changing teachers’ attitudes about diffe- 
rentiation. These findings are also of interest to those concerned 
With the “culturally disadvantaged” child, since certain differentia- 
tion practices can exacerbate his plight, whereas it would appear 
that non-differentiation might improve it. It must be remembered 
that these findings are concerned with one subject area only, and 
must be checked by future research in other subject areas. 
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CHAPTER 7 


Specialization and Age of Entry 
to School 


Two separate aspects of school organization are examined in os 
chapter. The first concerns the relationship between countries of ne 
number of subjects studied (specialization) in the pre-university yea 
by the mathematics group (Population ga) and the mean mathemat- 
ics achievement score. The second concerns the relationship par 
countries of the 13-year-olds (Population 1a) and 13-year-old grade 


š t: Rage ich the 
(Population 1b) mean mathematics scores and the age at which y 
entered school. 


Specialization 


In some educational systems, 


1 
pre-university year students study only 
three or 


four subjects and have been doing so since the age of siteen 
(England and Scotland) whereas in other countries all students ga 
expected to continue studying nine or more subjects to the end O 
their secondary school career. The English position is based on the 
alleged virtues of study in depth, The Swedish position (9 pu age! 
may be based partly on the assumption that, given the rapidity o 
technological change, which means that many of the next generation 
will almost inevitably have to be occupationally retrained at least 
more than once in their working lives, it seems that a broader educa- 
tion is more appropriate for the academically gifted. 

In those countries where specialization occurs, it often happens 
that students begin dropping subjects as early as 13 years of age (eg. 
England—see Jackson, 1966) and by the age of 16, there a8: an 
evident bias (arts versus science subjects) in the cluster of subjects 
studied. Does specialization really lead to a greater knowledge of the 
subject studied? It is possible to examine this in the light of the TEA 
data—knowledge in this case being defined as the mean achieve- 
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ment scores on the IEA mathematics tests. In Population ga, all stu- 
dents were studying mathematics in the pre-university year; in some 
educational systems, however, mathematics was studied in conjunc- 
tion with only two other subjects, whereas in other systems, it was 
Studied in conjunction with eight or more. 

There has been a great deal of discussion about the values of spe- 
Cialization, but no research appears to have been carried out. This is 
Perhaps not surprising, since within systems of education there has 
been a uniformity of practice. Furthermore, where a system has had 
Students specializing in three or four subjects only, it has been the 
brighter students who have studied four or five subjects and who 
would therefore be likely to be higher scorers than those only study- 
mg two or three subjects. The IEA Study is the first large-scale in- 
ternational study of its kind, and therefore this is the first time that 
Comparisons can be made of achievement between groups studying a 
limited number of subjects and those studying more. 

In the School Questionnaire, a question was asked about the aver- 
age number of subjects studied in each grade in the school. Unfor- 
tunately, the data obtained are limited in application, since in some 
Countries different interpretations have been put on the word “sub- 
ject” by different head teachers. Some have interpreted all “subjects” 
as including sport and drama, whereas others have included aca- 
demic subjects only. However, the data given in the Case Study Ques- 
tionnaire on the “number of subjects studied” would appear to be 
Mm order. Table 4.1 indicates the average number of subjects studied 
Per country (according to the Case Study Questionnaire), the mean 
Corrected mathematics score in each country, and the standard devia- 
tion and the number of students. 

If the eight countries showing eight or more su c 
combined to form one group, and the three countries showing four 
Or fewer subjects are combined to form a second group, then the 
mean Scores of the two groups are found to be g1.1 and 24.8 respec- 
tively, giving a difference of 6.3, which is highly significant. Students 
from countries where 8 or more subjects (of which mathematics is 
One) are studied at the pre-university level perform better in math- 
matics than students from countries where only four or less subjects 
(Of which mathematics is one) are studied. This is contrary to ex- 
Pectation. 

There are, however, complications. The United States system is 


ibjects studied are 


lll 


Table 7.1. Number of subjects studied and mean score by country. 
(Population ga) 


No. of Number 

subjects Mean Standard = ai 
Country studied score deviation studeni 
Belgium 9+ 34.6 12.6 519 
France 9+ 33-4 10.8 222 
Netherlands gt 31.9 8.1 La 
Japan 9+ 31.4 14.7 81 
Finland 9 25.3 9.6 369 
Fed. Rep. 

of nll 9 28.8 9.8 649 

Sweden 9 27.3 11.9 776 
Israel 8 36.4 8.6 146 
Australia 6 21.6 75 1089 
Scotland 4 25.5 10.5 1422 
U.S.A. 4 13.8 12.6 1568 
England 3 35.2 12.6 967 


a ee 


be- 
not as specialized as it would appear from the entry in the ba 
cause although it may be the case that only four “solids =a ade 
in 12th grade, they may not be the same “solids” as in 11 een, 
(or perhaps only one or two are the same in both grades) an coul 
the actual number of subjects studied in the last two grades itted 
range from four to seven or eight. If the United States is a be- 
from the specialist group, the average score of that group the 


e of 
comes 30.4, which is not significantly different from the averag 
31.1 of the first group. 


Assuming the IEA m 
ical achievement of the 
is surprising that stude 
significantly higher th 
It should be pointed 
educators h 
matics test 
syllabus in 
extent by t! 


athematics tests to be fair tests of manen 
various pre-university populations studie oe, 
nts from specialization countries do not $ w 
an students from non-specialization TE 
out perhaps that some English E 
ave stated that they did not think that the IEA ma ba 
extended the best students. Furthermore, in England, t i 
Applied Mathematics was covered only to a very sma 5 
he tests. Because of the wide range of scores between E 
tries within each of the two groups, it would seem that there are 0 


j i hich 
viously factors other than the number of subjects studied w) 
account for the differences. 
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y The average ages of the students in the eight countries (i.e. the 
first eight countries in Table 7.1) are, with one exception (Japan), 
over 18, while the average ages of the students in the four remaining 
countries are all under 18. Taking more subjects thus appears to be 
associated with a higher age, the assumption being that students 
Must prolong their school education to be able to carry the extra 
load. 

It is perhaps also of interest to note that in two of the three coun- 
tries in which four or fewer subjects are studied there is a mandatory 
age of entry to school of five years. The question of differing degrees 
of retentivity has been dealt with in Chapter 5, but is also relevant 
In these comparisons. It is striking that the students in Israel and 
Belgium do not differ very much from English students in age, since 
Belgium has approximately the same degree of retentivity as Eng- 
land and the mean mathematics scores of each of these countries are 
Close to each other, even though in England the average number of 
Subjects studied is five less than in the other countries. 

The conclusion that specialization, in the sense of restricting the 
number of subjects studied in the pre-university year, is not necessar- 
ily related to higher scores in mathematics, will probably be of in- 
terest to educational policy makers and planners in England, Scot- 
land and Australia. However, it must be emphasised that this study 


of specialization is extremely limited because of the wide differences 
dent variables which have not been 


On several important indepen 
It is important that further work is 


held constant in this analysis. À 
carried out both nationally (cf. Pidgeon et al, 1967) and nieta 
tionally. Hopefully, with IEA continuing in six subject areas it will 
be possible to examine the effects on other subject areas when spe- 
Clalization takes place in a particular subject. 


Age of Entry to School 


In each country there are regulations specifying when “normal” 
children (i.e. excluding such children as spastics, extremely mentally 
retarded, etc.) should at the latest begin compulsory schooling. In 
Some countries (e.g. Sweden and Germany) there is a single day in 
the school year on which’ all children within a year age range begin 
School. In others (e.g. Scotland and England) there are two or three 
Possible days of entry. In most areas in England, for example, all 
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children who will be five 


the 
years of age between September and 
end of December be 


o 
gin school on the first of September; op. 
will be five between January and the end of March begin bee ree 
first of January; and those who will be five between April a 
gust begin in the middle of April. . In certain 

As with most general regulations, there are exceptions. In f entry 
countries children slightly younger than the mandatory age ai the 
may begin school if there are exceptional grounds. It is o 
local school authority which then decides whether or not the i a 
are exceptional. In several European countries it is possi i£ they 
children to start school before they reach the mandatory oe emeni 
can prove that they are “mature” enough for school. The judg 
of this maturity has, up to the P 
of fitness for school, as well as c 
amples of this testing are the s 
Schulreife test in Germany. 

It should be remember 
schools are attended in 
lish-speaking countries 
but it is only a small 
the United States, ho 
kindergarten. In the 
approximately 50 per 
nelle (or jardin œ 


ical tests 
resent time, involved physical Ex- 
ertain group tests of EE the 
kolmognadstest in Sweden an 


ed, furthermore, that in all countess a 
different degrees. For example, m Or 
there are nursery schools and Bae In 
percentage of an age group which at 

wever, about fifty percent of children 4 that 
French-speaking countries it is wage ei ater 
cent of an age group attend the école peer 
enfants). Thus, the differences in amounts O: a 
schooling must be borne in mind when comparing at a later $ oat 
the performance of students from countries with different mandat 
ages of entry of school, un- 

As far as previous research is concerned, there are two cross-CO 


iffering 
try studies which have examined, in part, the effect of differ 


i 4 ntries 
amounts of formal schooling to which children in different cou 
have been exposed. Anderson (19 


64) has suggested that the apa 
ity of the performance of English and Scottish children over sages 
can students at the age of seven can be attributed to the extra y 3 
of schooling. But when differences occurred at ages ten and pe 
teen, he preferred to explain these in terms of differences in imn 
tion. Similarly, Pidgeon (1958), although finding English a a 
children superior to 11-year-old California’ children (English = q 
=29.1, standard deviation= 18.7 and California mean= 12.1, standar 
d 


nue i the 
eviation=6.8 on a 70 item test), states that the main reasons for 
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different levels in performance are probably due to the fact that for- 
mal teaching tends to be introduced at an earlier age in England, 
and to the fact that there is a difference in the standards in the two 
systems. He points out that in the United States more limited objec- 
tives are formulated for children of primary school age and less em- 
Phasis is placed on progress in mechanical arithmetic than is custom- 
ary in England. ; 

A national study which has relevance to this problem was carried 
out by Mogstad (1958) in Norway. It occurred that 12-year-old stu- 
dents in a rural region of Norway were in two parallel groups. One 
Sroup received the full week regular schooling for two years. The 
Second group received formal schooling for only half this period (i.e. 
half the amount of formal instruction), although it must be noted 
that the second group undertook much more homework due to the 
fact that they were in sparsely populated areas and could attend 
School for only half the time. In specially constructed achievement 
tests, the second group was only slightly inferior in performance at 
the end of the two years to the first group, even though the number 
of periods devoted to each subject was half. i 

The IFA Study is the first study undertaken where it has been 
Possible to examine differences between the performance of fully re- 
Presentative samples from more than three countries in a particular 
School subject. Here, it has been possible to compare the perform- 
ances of 13-year-olds in countries having mandatory ages of entry to 
School at five (two countries), six (six countries), or seven (two coun- 
tries), 

The two populations which it is relevant to examine in connec- 
tion with this problem are the 13-year-olds in each system (i.e., the 
la Population) and students in the grade where most 13-year-olds 
are to be found (i.e., the 1b Population). : 

The 1a Populations are chronologically comparable and are di- 
rectly related by age to the mandatory age of entry to school. If the 
various lengths of schooling up to the age of thirteen years make a 
difference, then it should be apparent in this analysis. i 

The second population is the grade population in which most 13- 
year-olds are to be found. Two extra countries to those in Population 
la are represented in Population 1b and for this reasons the 1b re- 
Sults are also presented. The actual grades tested have been given in 
Chapter 4. Although the standard deviations of age for Populations 
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Fe nd 1b. 
Table 7.2. Mean ages and standard deviations of age for populations 1a a 


Population 1a Population 1b 
Mean Mean Standard 
age in Standard age in degia- 
Country months deviation months ti 
Australia 161 3-5 159 i 
Belgium 162 3-3 168 = 
England 162 3.3 172 4 
Fed. Rep. 
of Germany — — 164 2 
Finland? 163 3:3 167 T 
France 162 3-5 163 T 
Israel — — 167 5. 
Japan 161 3-4 161 Je 
Netherlands 163 3.1 157 AEs 
Scotland 160 3.5 168 3-4 
Sweden 163 3.4 164 nH 
U.S.A. 163 3-5 164 
Median 162 3.4 164 6.7 
Range 3 0.4 15 8.2 


aN 


* See note on Finnish data on page 6. 
1a and 1b have alread 
here in Table 7-2 to 
in each country, 


n eated 
y been given in Chapter 6, they are atten 
gether with the mean ages of these pop 


-ding tO 
countries are grouped into three groups accor ne age- 
ndatory age of entry is five, six, or seven years es for 
The median age of entry for each country is given. The oes 7.3 
these figures is the National Case Study Questionnaire. Ta 


s nts for 
also gives the means, standard deviations and number of ae coun- 
the various groups. The averages for the different groups © 

tries are simple and no 


i d 
t weighted averages. If averages were e 
according to the number of students tested in each country, me 
would be biassed towards the averages of those countries where ee 
students were tested, This is not what is required, but straight av 
ages with each country regarded as a single observation. 16 
It is interesting to note that although the regulations for entry a 
school in England and Scotland differ, the actual median saree 
entry is the same, In England, the regulation is that children w. a 
will become five years of age up to and including the first day 
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Table 7.3. Mean scores and standard deviations of scores in mathematics 
for different ages of entry. 


Mandatory Median Population 1a Population 1b 

age of age of ————— —_—_—_— 

Country entry ety M sD N M sv. N 
temas 5yrs 5yrs 2 mo. 19.2 17.0 gor2 23.7 18.5 3148 
cotland 5 yrs 5 yrs 2 mo. 19.1 14.6 5256 22.3 15.7 5718 

19.2 23.0 
nro in 6 yrs 5 yrs 7 mo. 20.2 14.0 2916 18.9 12.3 3078 
“güm i 686 30.4 13-7 26 

Fed. Res: 6 yrs 6 yrs 2 mo. 27-7 15.0 1 30-4 3-7 2044. 
a Germany 6 yrs 6 yrs 5 mo. =e =a — 255 11.6 4476 
oe 6 yrs 6 yrs o mo. 18.3 12.4 2410 21.0 13.2 3549 
nae = = — 323 14-7 3232 


J 6 yrs 6 yrs 0 mo. 
pen Gys Gyrsomo. 312 16.9 3049 31-8 16.9 2049 


Netherlands 6 yrs 6 yrs 5 mo. 23.9 15-9 428 214 121 1444 

U.S.A. 6ye yesi Tg ley ge ma 8e 6544 
23.0 24.8 

Finland? 7 yrs 6 yrs 8 mo. 15.4 10.8 1156 16.1 11.6 1325 

Sweden 7 yrs 7 yrs o mo. 15-7 10.8 2553 15:3 10.8 2828 
15.6 15-7 


* See note on Finnish data on page 6. In Table 7.3 the scores given for Finland are 


t 
€ corrected scores. 


Next term begin school on the first day of this term. In Scotland, 


oy is those children who have become five years of age since the be- 
ginning of last term who begin school the first day of this term. 


Thus, one would expect the median age of entry to be about 4 


years 10 months in England, and 5 years 2 months in Scotland. 
hortage of places in 


However, it would appear that because of as 
Infants Schools in England, there is @ delay in children’s entering 
school. 

The differences in means are listed in Table 7.4. 


Table 7.4. Differences between mean scores of groups with different ages of entry. 


(Populations 1a and 1b). 


6 yrs 7 yrs IRS 

Population y. 5 yrs v. 6 yrs v. 54yrs 
ta 3.8 —74 —3.6 
1b 1.8 —9-1 —73 
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twice 
The application of the test of the difference being ser oe eee 
the complex standard error of sampling indicates that a. PE 
ences are statistically significant and that countries with poe chil- 
age of six produced, on average, higher scores than rg o be- 
dren enter school at 5 or 7 years of age. There is little dif p of coun: 
tween the two countries with a 5 year entry; a weak nice coun- 
tries with a 6 year entry do better than these two, but the eee 
tries with a 7 year entry do worse. This suggests that som 
tends delaying the entry until 7 years. 


Age of Entry and Social-Status Groups 


; social 
It was possible to break down the scores for Population a 6 and 
status groups. Table 7.5 presents the scores for social oF ee social 
for groups 7, 8 and 9 separately. The definitions of e Ag 
Sroups are given in full in Volume I, Chapter 8 of Hus 
(1967). The following is a brief description of each: 


Group 1—Higher Professional and Technical rietors; 
Group 2—Administrators, Executives and Working Propi 
large and medium scale 
Group 3—Sub-Professional; Technical , riculture, 
Group 4—Small Working Proprietors (other than in ag 
forestry, or fishing) 7 try» 
Group NRS and Managers in Agriculture, Forestry 


Group 7—Manual Workers: Skilled and Semi-Skilled EA 
(hired) in Agriculture, Forestry, Fishing n 
Manual Workers (excluding agriculture, 


6 

Although it would appear that children from social NRE het 
(professional and white-collar workers) benefit more from a mane 
to school than do children from groups 7 to g (farmers and me he 
lar workers), it is difficult to draw firm conclusions because Hie 
heterogeneity of Scores within each of the age entry. E Sl coun- 
are some interesting differences between social PA 
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Table 7.5. Mean score in mathematics by social-status group. 


(Population 1a) 


Groups 1-6 Group 7 Group 8 Group 9 
Cor a Pe N ——— ada pee, 
oy M S.D. N M sp. N M S.D. N M S.D. N 
29.54 17.19 931 15.50 1469 1764 16.09 11.66 50 27.61 17.32 10 
26.33 14.88 1456 17.13 19.57 3180 1704 13-77 122 13.27 12.54 IJI 
27.90 16.03 2387 16.81 14.13 4944 16.56 12.71 172 20-44 14.93 181 
31.62 14.17 863 24.83 14-72 662 24.49 21.99 9 21.19 13.92 107 
Nether] 21.88 13.31 895 16.85 11-09 1249 15-27 10.59 39 13-82 12.05 80 
x 29-47 16.21 210 19.28 13-70 185 14.64 9.97 20 2101 18.24 8 
; 33-30 16.61 1406 28.05 16.27 485 23:07 14.87 45 21.68 17.52 24 
Australia 20.17 13.62 2916 13.89 12.06 2645 12-23 10.45 102 12.89 11.78 28 
23.68 13.93 1380 18.15 13-18 1219 13.55 12.80 79 14-34 10.79 110 
26.69 14.64 7670 20.10 13.50 6445 1721 1344 294 1749 1405 357 
23.87 9.53 407 24.17 10.12 30I 18.17 11.33 9 17:19 9-79 25 
17.62 11.13 1226 14.45 1015 1075 1142 792 99 1221 8.33 49 
20.74 10.33 1633 1941 10-13 1376 15:07 9.62 118 1470 906 74 


* * 
The data here are the uncorrected Finnish data. It has not been possible to 


rerun these data since the mistake in the Finnish data was discovered. 
tries in Table 7.5. Group 7 in Finland has a higher score than 
Groups 1 to 6.3 The direction of the scores in Groups 7 to 9 in Eng- 
land is contrary to expectation (although the differences are not 
Statistically significant). 

The actual differences in scores from Table 7.5 are reported in 
Table 7.6. 


Table 7.6. Differences between mean scores in Table 7.5. 
(Population 1a) 


Groups 8 
and 9 

Groups 1-6 Group 7 Group 8 Group 9 combined 
5 yrs v. 6 yrs 1.21 —3-79 —0.65 2.95 1.19 
5 yrs v. 7 yrs 7-16 —3-10 1.49 5-74 3.62 
6 yrs v. 7 yrs 5.95 * 2066 2.14 2.79 2.43 


? This is more likèly to be a result of incorrect weighting than a realistic fact— 
see note on Finnish data on page 6. 
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It is clear that to make the mandatory age of entry to sat 
earlier (e.g. from 6 to 5) will not in itself improve performan a 
it is what happens in that extra year which is important. m 
particularly true for the children of bluecollar workers. It is 


eat ati : i more 
qualititative differences which must now be the subject of 
systematic research. 


Further Analyses Related to Age of Entry 


It has been pointed out in Chapter 3 in Volume II of ta a 
(1967) that “when the ga Population scores are adjusted for ouni 
ences in the proportions of an age group still at school, it 1$ o He 
that the gains between 1a and ga stages are directly related ee 
time interval between the two stages, the rate of gain being the a a 
in practically all of the countries”, In other words, the difference 
Scores between countries are already established by the age of 13- duca- 
Since this book is concerned with organizational aspects of e oe 
tional systems, it is worthwhile examining the relationship of ie al 
other organizational features in addition to age of entry to ic r-* 
to the differences in mathematics scores between countries of 13-Y° 
old students. ost 
The number of subjects studied in grade 8 (the grade where er 
13-year-olds were to be found) is of interest. Is, for example, el? 
studying of fewer subjects associated with higher scores at this a 
The number of subjects on average studied in each school as ae 
lected by means of the School Questionnaire. The figure given lik 
Table 7.7 is the average for each country. There is considerable aa 
ference in the length of preservice training of teachers as benne d- 
countries; this information consisting of the number of Po 
ary school years preservice training was collected from the Teach 7 
Questionnaire, Within countries, interest in mathematics account 
for a considerable amount of the variance and it is therefore of i 
terest in a between countries analysis. The interest score was derive¢ 
from various Pieces of information collected in the Student Ques 
tionnaire. The higher the score the greater the interest. (The a 
tion of this index is explained in detail on pages 212-213 in vor 
I of Husén et al., 1967). There is also considerable variation ea 
tween countries on the number of hours a week spent both in schoo 
and on homework. These data were collected through the Student 
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T: 3 E" 5 
able 7.7. Mean mathematics score and measures of various independent variables. 


(Population 1a) 


S Hrs 
Hrs home- 
Total No. of Pre- Inter. school work 
math. Ageof subjects service in per wk per wk 
Country score entry grade 8 training math. in math. in math. 
(1) (2) (3) (4) (5) (6) (7) 
Australi 
ince 20.18 6.0 8.7 2.8 59 38 24 
England 27.74 6.0 8.9 2.4 57 62 36 
Finland 19.31 5.0 8.9 3-1 57 38 17 
France 15.39 7.0 9-0 3.2 58 gp 18g 
Japan 18.32 6.0 8.5 2.1 55 45 34 
Netherlands 31.16 6.0 9.0 3-2 61 39 30 
Cotland 23.86 6.0 9-0 4.1 54 44 26 
Weden 19.05 5.0 8.2 4.0 53 43 23 
U.S.A. 15.70 7.0 9.0 4.6 58 57 19 
Grand m, 16.15 6.0 73 44 62 47 31 
Gaia, san 20.69 6.0 8.65 3.39 5740 4430 26.40 
i 0.67 54 0.85 2.88 940 6.24 


Questionnaire and again the higher the number the greater the num- 


ber of hours,+ 

pie 7. presents the data on each of th 
elem Mean Mathematics Score for Populat 
S 5, 6 and 7 have been multiplied b 
only for those countries for which dat 

ables are available. 
mee 7:8 presents the product-mo 
effete 7-7- Table 7-9 presents the sim 
ents and their products multiplied by 100. 
With as many as six constants fitted to ten observations it is clear 
that the multiple correlation will be rather spuriously high. None 
the less the regression coefficients are perhaps worth some attention. 
Let us take them in turn. The large negative coefficient for “age of 
entry” reflects chiefly the fact (see Table 7.3) that the countries de- 
laying age of entry until the age of seven are low scorers. The large 


oS 
tF . ie. %, : 
For detailed information ‘on how the data imn this paragraph were collected 


(except for “Interest in Mathematics”) see Appendix II of Volume I of Husén 
et al., 1967). 


e above variables as well 
ion 1a. For convenience, 
y ten. The data are pre- 
a on all of these vari- 


ment correlation matrix from 
ple correlations, regression Co- 
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Table 7.8. Product-moment correlation matrix of Table 7.7- 


7 
6 
I 2 3 4 5 
+45? 
180 
I 1.000 —.228 -377 —:334 070 106 .080 
2 1,000 -276 -137 -348 068 — 268 
3 1.000 = .301 — +249 = a —.462 
4 1.000 097 aa 139 
5 1.000 =:07% .356 
6 1.000 eS 
7 
Table 7.9. r, b and rb 100 of Table 7.8. 
r b rb 100 
R?=0. 967 
Age of entry —.228 — 894 20.38 R =0.983 
No. of subjects 
in grade 8 377 1.208 45-54 
Pre-service 
training — 334 .622 — 20.77 
Interest in math. 070 -465 3:25 
Hours school per 
week in math. «180 — .067 121 
Hours homework 
per week in math. +452 1.096 49-54 


Total variance accounted for 96.73 


positive coefficient for 
chiefly the fact that the 
only in the United State 
than 1 from the genera. 
of this high coefficient 
can be a main part o 


” cts 
“number of subjects in Grade 8 A is 
United States is a low scoring country. ore 
s that the number of subjects differs been 
1 average. This is the analytical expla! ell 
but it is hard to believe that this fact in low 
f the reason why the United States is A és 
Scorer; it seems much more likely that this is not a case eae’ a 
the cause of B or vice-versa, but rather a case where A and 
both caused by Something else, eee different 
The high coefficient for “pre-service training” is on a alive 
footing; common sense Suggests that there may well be a a hich 
lation here. “Interest jn Mathematics” has a high seq cens less 
may well correspond to a causal relation, though the direction i 
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S Ta interest in mathematics promote good performance, or 
cier e “ae promote interest in mathematics? It is possible for 
Echt fs p kold different views on this. The remaining high coeffi- 
or “hours of homework per week” and this strongly sug- 

Sests a causal relation. 
a rg independent variable within- 
ike + achers’ rating of the student’s opportunity to learn the items 
D aka (see Husén et al., 1967). Each teacher was asked to rate on 
Bavin Tae scale the proportion of his students taking the test 
n E had the opportunity to learn each item.5 These data were 
iese eg percentwise for each country. Table 7.10 presents 
ata for the eight countries where they were available as well 


aS repeating i Fat y eae 5 
ng in addition the measures of pre-service training, interest 


an i 
d hours school per week which have already been used above. 
7.12 is the large contribution 


oe striking feature of Table : 

ee y “Opportunity to learn”. What can this mean? The face 
€aning is clear enough. In the low scoring countries fewer boys 

and girls had covered the subject matter of the tests. Can the reason 


thin countries proved to 


Mean mathematics score and measures of pre-service training, opportunity to 
ek in Mathematics. 


learn, interest and hours school per we: 
(Population 1a) 


Table 7.10, 


Hours school 


Total 

math. Pre-service Opp. to Interest per week 
Co score training learn in math. in math. 
England 19.31 3.1 60 57 38 
Finland 15.39 3.2 47 58 3> 
France 18.32 2.1 50 55 45 
Japan 31.16 3-2 63 6r 39 
Netherlands 23.86 41 52 54 44 
Scotland 19.05 4.0 51 53 43 
Sweden 15.70 4.6 37 58 57 
U.S.A. 16.15 4-4 48 62 47 
Grand mean 19.90 3-59 51.00 57-25 42.87 
Grands.p. 5.31 °83 8.00 3-20 7-81 


—__ 


3 = 
For further details see Chapter 4 of Volume II of Husén et al., 1967- 
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Product-moment correlation matrix of Table 7.10. 


1 2 3 $ 2 
I 1.000 —.176 -751 +093 e 
2 1.000 —.473 -157 eee 
3 1.000 078 Mine 
=p 
1.000 x 
F 1.000 


ijt- 
be merely that the choice of subject matter of the tests was < rer 
able for these countries and that they might have done wot this 
there been a different choice of subject matter. On the who ae 
Seems unlikely. It is certainly less likely at this level than a dif. 
higher level (Population ga). At the higher level there is pon 
ference of opinion, both within countries and between cou bout 
about what the mathematical curriculum ought to be but ptt 
the curriculum at the age of thirteen there is a fairly close cons Oe: 
It seems likely therefore that in countries where the index o ss in 
portunity to learn” was low the students have made ws gure 
covering a broadly international curriculum than those nan A 
where the index was high. The countries where the index is sk are 
the countries where compulsory schooling extends longer. T. etl 
in fact the United States, Sweden and Finland. In the two Scand ih 
vian countries compulsory schooling does not begin until bi er 
the United States the proportion staying on after the compu A 
stage of schooling is high. A Jate entry would account for the ta 


Table 7.12. r, b and rb r00 of Table 7.11. 


ë b rb 100 
Pre-service 2= 0.658 
training —=.176 +132 “age = = 0.81! 
Opp. to learn “751 -984 73-99 ji 
Interest in math, 093 = ~~ 
Hours school per 3 
week in math. —.194 -298 -5:78 
Total variance accounted for 85:80 
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that less progress has been made through the curriculum by the age 
of thirteen. A late age of leaving might also account for it on the 
ground that there is still a lot of schooling to come after the age of 
thirteen, 


Summary 


The number of subjects studied by pre-university students studying 
mathematics ranges from an average of three in England to nine or 
More in several other systems of education. When a comparison is 
made between the mean scores of mathematics students from those 
Systems where eight or more subjects are studied and those where 
four or fewer are studied, there is no significant difference in score. 
The conclusion that specialization, in the sense of restricting the 
number of subjects studied in the pre-university year, is not neces- 
sarily related to higher scores in mathematics, must be of interest to 
€ducational policy makers and planners in those countries where on 
average only few subjects are studied. In those countries where more 
Subjects are studied, the age of terminating secondary schooling 
tends to be higher, and those countries where the age of terminating 
secondary schooling is lower tend to be those where the mandatory 


ge of entry to school is lower. 

The mandatory age of entry to school is ; 
land, seven in Sweden and Finland, and six in the other systems 
Paticipating in this study. The different degrees of pre-school attend- 
ance in the different systems are pointed out. When a comparison 
of mean scores of 1 g-year-old students with different ages of entry is 
made, differences are in favour of those entering at the age of six, 
but it must be remembered that the six year of entry scores are very 
heterogeneous. The average of the 1 g-year-old scores in Sweden and 
Finland (the latter, unweighted scores) is considerably lower than 
the average of the 1g-year-olds with an age of entry of either six or 
five years. J 

Again, although it is easy to pick out pairs of countries to dem- 
Onstrate that earlier age of entry would mean higher scores, the 
overall conclusion must be that age of entry at five or six is not 
associated with mathematics score at age 13- The extra year of school- 
ing employed by those entering at five would not appear to be of 
consequence as far as progress in mathematics is concerned, whereas 


five in England and Scot- 
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a 
the loss of a year’s schooling between six and seven appears to na 
a detrimental effect. pal and 

Although it would appear that children from professiona cat 
white-collar social groups benefit more from early entry Oates 
than do children from farmer and blue-collar social group, it is a 
cult to draw firm conclusions because of the heterogeneity of a 
within each of the age of entry groups. However, this finding ~~: 
surprising, since it is to be expected that higher social group pa a 
are likely to take more advantage than lower social group "ripe af 
a system with a fixed age of entry, since they are geared to that e 
entry. It would be interesting to examine whether lower social gr a 
children really did score higher when given the chance to have € 
lier entry to school than some of their peers within a country. “aan 

It is, however, clear that to make the mandatory age of pos 
school earlier will not, in itself, improve performance. It high = 
happens in that extra initial year which is important and it a te 
qualitative differences which must now be the subject of more SY 
tematic research. PEE 

In an attempt to discover if other aspects of school siti: 
were likely to be of more importance when trying to accoun fea- 
differences between countries in scores of 1 g-year-olds, certain dif- 
tures were selected where there was known to exist considerable a 
ference in practice between countries. The features chosen ‘a 
number of subjects studied in the grade where most cpap 
were to be found in the school system, pre-service training of ae 
ers, hours school per week and student’s opportunity to learn Bes 
items on the test (i.e. the student's programme). Two other varia she 
which pertain to some extent to the school and to some extent w id 
home were also chosen. They were “interest in mathematics a 
“hours homework per week”. es 

The correlations between these variables and national mean scor t 
provided evidence of association. The regression equations yet 
that the strongest evidence of association lay between the ee 
Scores and the amount of pre-service teacher training, the amonak a 
homework and the extent of the opportunity to learn. Evidence © 
association is not of itself evidence of a causal relation but it on 
reasonable enough to think that in these cases the relation is causa y 

From other national research (cf. Peaker, 1967) it is known ry 
for primary school children within England school variables accoun 
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for about only twenty percent of the variance, whereas home vari- 
ables (including parental attitudes and aspirations as well as socio- 
€conomic variables) account for about fifty percent of the variance. 
It is therefore suggested that in future international research school 
Variables should be taken in conjunction with home variables when 
trying to account for differences between countries. It may turn out, 
Of course, for home variables that unlike their contribution within 
Countries, their contribution between countries is small. 
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CHAPTER 8 


Summary 


It has been possible to use the data collected in the first phase of me 
research carried out by the International Project for the ies 
of Educational Achievement (IEA) to examine problems of schoo 
organisation where there is considerable diversity of practice between 
systems. It would be difficult to examine some of these problems ‘a. 
rectly by experiment, for reasons that are plain enough. put wha 
diversity of practice already exists across countries, it is possible 
compare practices, each of which is operating in its natural =e 
ie. within the context of the philosophy, traditions and attituc f 
inherent in its genesis. It is obvious that these variables which are © 
extreme importance in education would be extremely difficult, poj 
to say impossible, to control in a specially designed experiment. d 

The IEA has constructed international mathematics tests and a®- 
ministered them to representative samples of students from pee: 
populations in full time schooling: (a) all 13-year-olds, (b) all se 
dents in the grade where most 1 g-year-olds are to be found, (c) 4 is 
pre-university mathematics students and (d) all pre-university nom 
mathematics students, Questionnaires to collect background informa- 
tion were also constructed and administered to the students tested, 
their mathematics teachers and their school principals. The data 
were filed on to magnetic tape and data analysis was carried out $ 
the University of Chicago Computation Center. The data presented 
in this monograph have been culled from the IEA data. A 

The first practice to be examined was that of retentivity—the 1" 
verse drop-out rate of a system of education (see Chapter 5). The pee 
portion of an age group still in school in the pre-university yea 
varied for those students studying mathematics from four percent ss 
Belgium to eighteen percent in the United States and for those gos 
studying mathematics from three percent in the Netherlands to fifty- 
two percent in the United States. n 

The average level of mathematics performance of pre-university 
students is lower in those countries with larger percentage of an agë 
group still in school at the pre-university level. This is true for both 
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Students studying mathematics and those not. However, the perform- 
ance of the best students is much the same in all systems. However, 
when the achievement “yield” (mean score multiplied by the propor- 
non of an age group in school) of the pre-university students is ex- 
amined, it can be seen that by increasing the retentivity of a school 
System, it is possible for a system to have both a high overall yield 
and an undiminished élite yield. Germany and Belgium have rela- 
tively high yields at the 13-year-old grade level and relatively low 
Yields at the pre-university level. 

These facts are of interest particularly in those European systems 
Of education where the possibility of increasing retentivity is being 
¢xamined and where many strong rearguard actions are being fought 
mainly concerning the maintenance of academic standards. In future 
research, it should be possible not only to refine the measurement of 
‘acquired yield” and indicate this in various subject areas, but also 
to compare “acquired yield” with “required yield” (cf. Dahlléf, 
1963). The final decision of whether or not to increase the retentivity 
Of a system will be based on economic, political and many other fac- 
tors, 
ces to be examined concerned differentia- 
tion—inter-school grouping, and within the field of intra-school 
Stouping, the practices of ability grouping and age versus grade pro- 
Motion (see Chapter 6). Unfortunately, no adequate measure of the 
extent of inter-school grouping exists (in future research, suitable 
Measures should be created; a possible lead might be the coding used 
for School type Selectivity in Pidgeon et al., 1967). However, a scru- 
tiny of the data available for 1g-year-olds and equivalent gr ade popu- 
lations suggests a positive relationship between the standard devia- 
tions of scores and inter-school grouping. Grade promotion systems 
have smaller standard deviations than age promotion systems; fur- 
thermore, the greater the degree of grade repeating, the smaller the 
Standard deviation. The more ability grouping practised in a system, 
the larger the standard deviation of scores. However, when the 
amount of ability grouping practised was partialled out of the rela- 
tionship between grading and the standard deviation of scores, there 
Was no relationship for the 13-year-olds”: scores (i.e. those who, in 
grade systems, are spread across several grades). 

Thus, inter- and intra-school ability grouping is associated with 
large standard deviations. From other knowledge, it would seem that 


The second set of practi 
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it is the lower social groups (culturally disadvantaged children) who 
are mainly responsible for the wide standard deviation by having 
low scores. In a non-differentiated system, they tend to score wees. 
thus reducing the size of the standard deviation. Although the ane 
of scores required within a society must be determined on other ne 
purely educational grounds by that society, there are strong a8 : 
ments for the creation of a non-differentiated system, if the pe 
tion is made that it is the duty of society to give every oppor a 
to each child to develop to his maximum. It is, however, pointed a. 
that the problem of change in the area of differentiation is not of 
rely that of taking an administrative decision for change, but that i 
changing the attitudes, particularly of the teachers, within the so F 
ety—de jure abolition of a practice does not mean that de ine t 
will not exist (cf., inter-school grouping in Japan). richer 
should be realised that if inter-school grouping is abolished, but E 
tra-school grouping remains, the standard deviation of achievem 
scores will not be much reduced. ation (the 
The third practice to be examined was that of spēčializato a 
number of subjects studied) in the pre-university year (see CA 
ter 7). The conclusion is that specialization, in the sense of res not 
ing the number of subjects studied in the pre-university year, àj 
necessarily related to higher scores in mathematics. hool 
The fourth practice was that of mandatory age of entry tO Jot fs 
(see Chapter 7). Table 7.3 shows that there is not much to ee 
between entry at g years of age and entry at 6 years of age but vai 
lower scores at 13 years of age are associated with entry at 7 Lae 
age. When the performance of 13-year-old students from diana er 
cial groups is examined, it would appear that students from big a 
social groups benefit more from early entry to school than do $ a 
dents from lower social groups, but it is difficult to draw firm E 
clusions, because of the heterogeneity of scores within each of t 
age of entry groups. J 
It is clear that to make the mandatory age of entry to schoo” 
earlier (e.g. from six to five) will not in itself improve performance 
it is what happens in that extra year which is important. This 1s pa 
ticularly true for the children of blue-collar workers. It is the qualita 


5 : p. ic 
tive differences which must now be the subject of more systemat! 
research, 


. F: : A 5 
An examination of other variables likely to account for differenc 
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between countries in the mathematics scores of 1g-year-olds revealed 
the importance of the student’s opportunity to learn the mathemat- 
ics involved in the tests (as rated by the mathematics teachers). This 
1S related to some extent to the qualitative differences mentioned in 
Me paragraph above. It will be of particular interest to mathematics 
educators to examine the statistics of each item in each of the coun- 
tries and to consider why 13-year-olds in some countries can perform 
Well on the item while their counterparts in other countries perform 
only poorly, 

Of the other variables examined, important ones seem t 
Preservice training of the teachers and the number of hours of total 
homework (not just mathematics homework). 

| Although the first object of any inquiry of 
find evidence of association there is a further, 
“lon. When evidence of association has been found how is it to be 
iMterpreted? Evidence of association is necessary if causal relations 
are to be inferred, but it is not enough. When we find an association 
between the amount of rainfall and the growth of crops we infer that 
itis the rainfall that causes the growth and not vice-versa. But when 
We find an association between interest in mathematics and perform- 
ance in mathematics there may be a difference of opinion whether 
ìt is the interest that promotes the performance or the performance 


that promotes the interest. aye 

In this study the author has presented the evidence of association, 
and has gone on to use the evidence to make those inferences which 
Seem to him most likely. He recognises that in the last resort the 
Interpretation must depend upon memory, introspection, and testi- 
mony and these may differ from one interpreter to another. ‘These 
are grounds for caution in interpretation. They are not grounds for 
refraining from the attempt to interpret. 

This study, and the parent study (Husén et al., 1967), are first 
attempts at quantitative international surveys of educational 
achievement. At the outset many novel problems of measurement, 
representation and control were encountered. In the later stages 
there were problems of interpretation. It is to be expected that as 
time goes on more progress will be made in dealing with these diffi- 
culties, and that some of the conclusions reached on the present evi- 
dence may need revision as better evidence accumulates. But it may 
not be unduly sanguine to hope that some, at any rate, of the con- 
clusions will stand, 


o be the 


this kind must be to 
more difficult, ques- 
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Appendix 


Table A.1. Participants in I.E.A. 


Representing National Centers 
“an ‘5 P. Keeves, Australian Council for Educational Research, Hawthorn Ea 
m E BE ves, 
Victoria. 
Belgium i Morlanwelz, 
rada F. Hotyat, Institut Supérieur de Pédagogie de Morlanwelz, Mor > 
- > 
Hainaut. 
England iller, The National Foundation 
i K. M. Miller, The 
Dr. W. D. Wall, Mr. D. A. Pidgeon, Dr. i t, London, W.1. 
for ae tae Record in England and Wales, 79, Mire pols BEC 
P iie 
a blic of Germany Professor Dr. W. Schultze, Deutsches Ei miin 
epublic o! erma: _ Schlossstrasse 29. 
ternationale Pädagogische Forschung, Frankfurt/M. Sc! 

Finland R i 
Professor M. Takala, Mr. O. Ylinentalo, 
versity of Jyväskylä, Jyväskylä. 

France 
Professor G. Mialaret, Université de Caen, 
Humaines, Caen. 

Israel 
Dr. M. Smilansky, 
Sciences, 80 Haneviim Street, Jerusalem. 

Japan iima, Dr. S. Kubo, National In- 

; da, Dr. M. Kojima, z 
Profi S. Sakakibara, Dr. T. Harada, $ o, Meguro-ku, Tokyo. 
Siete r Pducationsl Research, 6-5-22 Shimomeguro, 
Netherlands N 
ede: 
Professor S. Wiegersma, Dr. M. A 
Geneeskunde, 56, Wassenaarseweg, Leiden. 

Scotland 3 ch in Edu 
Dr. D. A. Walker, The Scottish Council for Research » 
Place, Edinburgh 3. 

Sweden ee 
Professor Dr. T. Husén, Dr. S. mete im ah 
cation, University of Stockholm, Stockho 

U.S.A. Department of Education, Uni- 

B. S. Bloom, Dep: ae 
Professor C. A. Anderson, Professor Chicago 37, Illinois. Professor A. W. 
` A 3 k Avenue, cag’ 2 7 S — 
aes a ae as Teachers College, Columbia University, New 
Os! ay, Professor + die 
York. 


Center for Educational Research, Uni- 
Faculté des Lettres et Sciences 


i i 1 
Henrietta Szold Institute for Research in the Behavioural! 
enrii 


rlands Institut voor Praeventieve 
cation, 46, Moray 


Mr. L.-M. Björkquist, School of Edu- 


Consultants 
Test Editors o 


Professor R. L. Thorndike, Mr. D. A. Pidgeon. 
ea yi Png ae Grasmere, Ambleside, Westmorland, England. 
GF nj CBE, 
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Comparative Educationist 


$ t, 
Mr. R. F. Goodings, University of Durham Department of Education, Old Elvet, 
Durham. 


Data Processor 


Dr. R. M. Wolf, University of Chicago. 
Coordinator 


å A burg- 
Mr. T. N. Postlethwaite placed at the Unesco Institute for Education, Hamburg: 


Table A.2. Summary of topics for populations ra and 1b. 


PPE: nce 
Subject matter Objectives Importa 


ooo ARITHMETIC 


001 Reasonable competence in the 4 operations on natural 

numbers A;B ý 
002 Ability to carry out simple operations involving decimal 

fractions A,B ‘ 
003 Ability to carry out simple operations involving simple 

vulgar fractions A,B j 
004 Understanding the concept of fractions (vulgar and deci- 

mal) G, D : 
005 Application of (oor)-(004) to everyday life situations C, D a 
006 Measurement of quantities, including length, area, volume 

capacity, time, speed and money A,B $ 
007 Notion of ratio and proportion, including percentages A, C 5 
008 Notion of arithmetical mean A,C z 
00g Interpreting and making of simple practical graphs and 

tables A,B,C a 
o10 Intuitive understanding of properties of operations, i.e. 

associative, distributive, commutative laws A,D a 
orr Expression of these laws by means of letters B, G i 
012 Prime factors, divisors and multiples A,B ° 
013 Notions of powers and simple calculations of area and 

volume A,C é 
014 Notions of number systems other than the decimal system A, D, E a 
015 Notions of square roots i ‘ 
100 ALGEBRA 
101 Notions of positive and negative numbers/graphical re- 

presentation A,G 3 
102 Extension to all positive and negative rational numbers 

of the four fundamental operations AB > 
103 Negative and zero exponents AG : 
104 Formulae and algebraic expressions e 3 
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Table A.2. (Continued.) 


Subject matter Objectives Importancee 


105 Numerical evaluation of these formulae and algebraic 
expressions 

106 Operations with polynomials and monomials 

107 (x+y)?, (x—y)? 
(x+y) (x-y) 

108 Notions of equation ; 

109 Equations of the first degree with numerical coefficients 

110 Simple problems using (109) 

111 Simple systems of linear equations with two unknowns 

112 General (modern) notions of functions 

113 Graphical representation of the functions of the type: 
y=ax; y=ax+b; y=a/x; y=ax? 

114 Elementary notions of sets 


HOW OH 


200 GEOMETRY 
201 Intuitive treatment ofsome geometrical figures: angle, 
triangle, square, parallelogram, rhombus, trapezium, 
circle 
202 Intuitive treatment of: straight line, 
perpendicular and parallel 
203 Intuitive treatment of symmetry and congruence 
204 Intuitive treatment of translation and rotation 
205 Measurement of distance and angles r 
206 Simple constructions with graduated ruler, straight edge, 
compasses, protractor, etc. ; 
207 Intuitive treatment of similarity. Scale drawing 
208 Properties of simple solids 
209 Calculation of area and volume s 
210 Simple deductive reasoning based on the following: 
(a) properties of angles determined by 2 parallel lines; 
cut by a transversal and the sum of the angles in a 
triangle; 
(b) symmetry of isosceles triangle and rhombus; 
(c) fundamental conditions of congruence of 2 tangles 
(SSS, SAS); 
(d) inequality in triangles; 
(e) characteristic properties of the parallelogram. 
211 Simple deductive reasoning based on the following: 
Properties of the inscribed angle of a circle % 
212 The theorem, of Pythagoras for solving simple practical 
problems A, B, C 2 


—— ss 
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opposite angles, 


kad 
Q 


Table A.3. Summary of topics for population 3. 


Subject matter Objectives Importance 


1.0 SETS, RELATIONS AND FUNCTIONS 
1.1 Sets 
Notion of Sets 
Intersection of Sets 
Union of Sets A,G 3 
Inclusion of Sets 
1.2 Relations and Functions 
Condition in 2 variables 
Sets of ordered pairs, relations A, C,D 3 
Functional relations, etc. 


2.0 ARITHMETIC 
2.1 General treatment of number systems in terms of letters A; 
2.2 Natural numbers A,D 
2.3 Integers A,D 
2.4 Real numbers A 
2.5 Complex numbers A, 


eRe Hw 


3.0 ALGEBRA 

3:1 Polynomials A,B z 
Operations and Factorization 

3:2 Equations and Inequalities A,B,C, D 

3-3 Irrational equations > 

3-4. Systems of equations A, B, C, D 

3-5 Matrices and determinants 


PEP 
w ts 

Q 
Peer pees 


4.0 ELEMENTS OF ANALYSIS 
4.1 Polynomial functions 

42 Rational functions 

4.3 Irrational functions 

4-4 Circular functions 

4.5 Inverse-circular functions 

4.6 Logarithmic and exponential functions 
4.7 Limits 

4.8 Continuity 

4.9 Derivatives 

4.10 Integrals 

4.11 Series 

4.12 Differential equations 


Ñ 


Deo oo 
Q 
s] 


r E-E-E-ES) 


Q 


vv 


PPPRP? 
ae 
vy 

me DPWONHWOW KOH HW 


5.0 GEOMETRY 


5-1 Geometry mainly according to Euclid 
5:2 tgth-century geometry (projective, affine, etc.) 


>> 
Cr 
vy 
[e] 
n 
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Table A.g. (Continued. 


Subject matter Objectives ‘Importance 
53 Trigonometry A,B,C 

5-4 Analytical geometry A, B, C, D 2 
5:5 Vectors A,B,C I 
6.0 PROBABILITY AND STATISTICS 

6.1 Descriptive statistics A,B,C 2 
5:2 Probability A, B, C, D I 
6.3 Distribution A, D 1 
6.4 Statistical inference A £ 
70 LOGIC 

7-1 Elementary formal logic A,C,D I 
7-2 Deductive systems A,D I 
8.0 HISTORY OF MATHEMATICS A 1 


9:0 ADDITIONAL TOPICS 


Table A.4. Regression scaling of 1b and 3a onto the 3b scale. 


Regression of Regression of 


test 3 on test 5 1b ga 3b 1b ga 

gb score gb score Mean Mean Mean Mean Mean 

proath, yoath, test 3 test5 total scaled scaled 
Belgium 0.011 2.041 7.215 2.072 4.964 14.905 2430 10.12 38.10 
England —2.109 2.095 8.398 2128 4.156 14.659 22.10 6.60 39.59 
Finland —0.940 2.027 6,825 2.034 4-308 12.942 22.50 7:79 33-15 
Germany 3.083 1.928 10.340 1.875 4.704 12.381 27.65 12.15 33.55 
Japan —6.268 2.491 8.046 2.234 6.104 14.326 25-36 8.94 40.05 
Scotland —2.029 2.053 7-926 2.160 3.499 12-424 20-77 5.15 34.76 
Sweden —0.488 1.553 9.028 1.758 2.151 12.436 12.69 2.85 30.89 
USA. —1.105 1.848 4.375 2.146 2.244 7.066 8.63 3-04 19.56 


Table A.5. Indices of social bias. 


Country Pop.ga 3b |Country Pop. 3a 3b} Country Pop. 3a gb 


SE Ss Ss 
a 
Australia 4-7 — |Finland 6.0 3-7| Netherlands 12.3 

Belgium 3.6 7-3| France 17-3 — {Scotland 10. p= 
England 16.2 24.5| Israel 3.6 — |Sweden ee aed 
Fed. Rep- j Japan 6.0 2.9| U.S.A. : #o 


of Germany 45-3 56.4 rg wO 
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Table A.6. Means, standard deviations and N’s for total mathematics score, lower mental 


process and higher mental process by sub-sample. 


(Population 1b) 


Total math. score 


Lower mental 
process score 


Higher mental 
process score 


fn eS 
Country M S.D. N M sD. N M so. N 
AUSTRALIA 
Subsample 1 17-58 12.34 770 13.83 9.53 770 3.76 3.65 77° 
Subsample 2 18.32 11.30 769 14.86 9.03 769 3.46 3.28 gsi 
Subsample 3 21.44 12.42 770 16.90 9.78 770 3.59 3-71 709 
Subsample 4 18.16 13.04 770 14.56 10.10 770 359 371 77 
Average 18.88 12.28 770 15.04 9.61 770 3.84 353 77° 
BELGIUM 6 
Subsample 1 26.43 12.96 661 12.15 10.09 661 5.28 3-72 be 
Subsample 2 32.37 14.05 661 17.92 11.93 661 5.06 4.30 om 
Subsample 3 34-04 12.74 661 26.95 9.55 661 7.13 3-99 661 
Subsample 4 28.90 15.25 661 22.53 11.51 661 6.38 4-45 661 
Average 30.43 13.75 661 23.98 10.41 661 6.46 4-17 
ENGLAND 
Subsample 1 25.25 18.45 793 19.22 14.21 793 6.03 486 bo 
Subsample 2 22.28 18.81 789 16.95 14.33 789 5:28 493 7 
Subsample 393.69 177-3 773 18.31 13.44 773 738 486 773 
subsample 4 23.71 1903 793 18.23 1473 793 5.47 49 787 
Average 23.76 18.53 787 18.20 14.19 787 556 490 787 
FINLAND 
Subsample 1 25-98 9.59 210 19.37 6.88 210 6.07 3-55 an 
Subsample 2 25:51 856 210 19.48 661 210 603 289 a 
Subsample 3 26.43 9:73 210 20.19 7.40 210 6.25 314 ?! 
Subsample 4 27-55 10.39 210 20.25 7.69 210 7.30 3-43 = 
Average 26.37 9:57 210 19.82 7-15 210 6.54 3-25 ay 
FRANCE 
Subsample 1 19.10 13.95 922 15.18 10.54 922 3.91 395 997 
Subsample 2 22.87 12.99 924 1812 9.77 924 4.76 3.96 924 
Subsampleg 21,09 12.92 710 16.70 9.68 710 4.39 388 71° 
Subsample 4 20.76 13.05 893 16.75 9.92 893 4.01 3.76 893 
average 20.96 13.23 862 16.69 9.98 862 4.27 3.89 862 
GERMANY 
Subsample r 23:95 11.67 1119 18.72 8.94 1119 524 343 1119 
Subsample 2 23.22 12.76 11 19 1764 9552 1119 558 3.78 1119 
Subsample 324.86 10.98 1119 21.88 8.13 1119 5.92 3-73 1119 
Subsample 4 26.85 11.41 1119 20.69 859 1119 6.16 3-43 1119 
Average 25:45 11.70 1119 19.73 8.80 1119 5.72 3.59 1119 
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Table A.6. (Continued.) 


Total math score 
———_. 


‘Lower mental 
process score 


Higher mental 
process score 


Country M sp. N M s N M sp. N 
HOLLAND 
Subsampleı 21.89 12.11 361 16.88 9.03 361 5.01 3.74 361 
Subsample 2 19.53 12.71 361 15.01 9.70 361 4.52 3.61 361 
Subsample 3 21.79 10.68 361 16.72 8.04 361 5.03 3.46 361 
Subsample 4 22.52 12.94 361 17-40 9.62 361 5.13 3.80 361 
Average 21.43 12.12 361 1651 g10 361 4.92 3.68 361 
ISRAEL 
Subsample1 34.95 1420 834 26.31 10.16 834 864 4.75 834, 
Subsample2 = g1.11 13-88 759 23-86 984 759 735 465 759 
Subsampleg 29.76 16.60 8o5 22.83 12.10 805 6.93 508 805 
Subsample 4 33-35 13:99 834 25.38 10.10 834 797 462 834 
Average 32.29 14.67 3232 24.59 10.55 3232 7-70 4.77 3232 
JAPAN 
Subsample 1 32.38 17.00 512 25.52 12.56 512 6.86 5.07 512 
Subsample 2 31.28 16.92 513 24-40 12.54 513 6.87 5.02 513 
Subsample3 grrr 16.73 512 24-54 1233 512 6.57 4.98 512 
Subsample 4 29.87 16.94 512 23.69 1251 512 619 5.07 512 
Average 31.16 16.90 2050 24.54 12-48 2050 6.62 5.03 2050 
SCOTLAND 
Subsample 1 23.72 15.22 1443 1848 11-75 1443 524 408 1443 
Subsample 2 22.72 16.60 1440 17-62 12.70 1440 510 448 1440 
Subsample 3 20.45 15.92 1440 15.96 12.39 1440 449 4.17 1440 
Subsample 4 22.32 15.03 1395 17:57 1191 1395 4-75 3-83 1365 
Average 22.31 15.69 1425 1741 1218 1425 4.90 4.14 1425 
SWEDEN 
Subsample 1 15.97 10.81 727 11-55 8.32 727 342 338 727 
Subsample 2 14.32 10.35 656 11.32 8.12 656 3.00 3.05 656 
Subsample 3 15.56 11.48 737 12.14 8.89 737 3-41 3.36 737 
Subsample 4 15.20 10.73 708 12.07 8.30 708 3.12 3.27 708 
Average 15.26 10.83 707 12.02 841 707 3.24 3.26 707 
UNITED STATES 
Subsample 1 17.42 13.49 1622 14.20 10.42 1622 3-22 3.80 1622 
Subsample 2 19.14 1890 1639 15-35 9-93 1639 3-79 3-73 1639 
Subsample 3 | 18.23 12.98 1662 14.69 10.09 1662 3.54 3.64 1662 
Subsample 4 16.61 13.89 1621 13.53 10:66 1621 3.07 3.92 1621 
Average 17.85 13.92 6544 14-44 10-28 6544 3.40 3.77 6544 


Table A.7. Means, standard deviations and N’s for total mathematics score, lowi 
process and higher mental process by sub-sample. 


(Population 1a) 


Total math. score 


m 


Lower mental 
process score 


er mental 


Higher mental 
process score 


Go a ty 
Country M s.D. N M S.D. N M sD. N 
AUSTRALIA 
Subsample 1 20.37 14.60 729 16.07 11-34 729 430 3:97 729 
Subsample 2 19.33 13-48 729 15.56 10.59 729 3-78 3:69 729 
Subsample 3 22.21 14.31 729 17-59 1105 729 462 403 729 
Subsample 4 18.82 13.65 729 15.04 10.65 729 3-77 3.76 729 
Average 20.18 14.01 729 16.06 10.09 729 412 386 729 
BELGIUM 
Subsample 1 23.67 1411 387 19.04 11.02 387 4.63 3-92 387 
Subsample 2 28.53 14.82 433 22.34 11-16 433 6.19 434 433 
Subsample 3 0.94 15.15 433 244I 11.70 433 6.52 416 433 
Subsample 4 27.82 15.99 433 21.58 12.05 433 6.25 4.62 433 
Average 27.74 15.02 422 21.84 11.48 422 5.90 4.26 422 
ENGLAND 
Subsample 1 33.02 15.89 736 25.00 12.14 736 8.02 4-55 736 
Subsample 2 13.88 12.47 776 1051 913 776 3-78 3.80 776 
Subsample 3 15.10 11.23 750 11.03 8.77 750 4:07 3-09 75° 
Subsample 4 19.19 17:53 750 14.77 1361 750 443 453 75° 
Average 19.31 16.97 753 14-79 13-17 753 453 4-42 753 
FINLAND 
Subsample 1 24.55 10.07 187 18.21 7.17 187 6.34 375 187 
Subsample 2 23.24 916 187 1785 717 187 539 29! 187 
Subsample 3 24.30 9.67 187 18.40 7.39 187 5-90 2.96 187 
Subsample 4 24.16 10.52 187 17.89 7-74 187 6.28 3-43 187 
Average 24.06 9.85 187 18.09 7.36 187 598 386 187 
FRANCE 
Subsample 1 13.96 10.40 589 11.31 8.28 589 2.64 2.84 589 
Subsample2 22.02 13.60 662 17.99 10.30 662 4.62 4.05 662 
Subsample 3 19.69 13.18 523 15.47 9.83 523 422 3-90 523 
Subsample4 17.61 12.30 636 14.32 941 636 329 3-57 636 
Average 18.32 12.37 6o2 14.62 9-45 602 370 3.59 602 
HOLLAND 
Subsample 1 24.59 15.62 107 18.95 11.70 107 5:64 4.35 107 
Subsample 2 24.18 18.36 107 18.53 13-73 107 5.65 5.01 107 
Subsample 3 22.72 14.22 107 17.48 10.82 107 5:24 3:90 107 
Subsample 4 23.98 15.46 107 18.45 11:65 107 5:53 443 107 
Average 23.86 15.91 107 i835. 11:98 197 (5:53) 442) 107, 
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Table A.7. (Continued.) 


Country 


JAPAN 
Subsample 1 
Subsample 2 
Subsample 3 
Subsample 4 
Average 

SCOTLAND 
Subsample 1 
Subsample 2 
Subsample 3 
Subsample 4 
Average 

SWEDEN 
Subsample 1 
Subsample 2 
Subsample 3 
Subsample 4 
Average 

UNITED STATES 
Subsample 1 
Subsample 2 
Subsample 3 
Subsample 4 
Average 


Total math score 


M 


1540 
1566 
1582 
1543 
1558 


Lower mental 
process score 


Higher mental 
process score 


—_——X—__ 
an M sD. N 
12.56 512 6.86 5.07 512 
12.54 513 687 5.02 513 
12.33 512 657 498 512 
12.51 512 6.19 5.07 512 
12.48 512 662 5.03 512 
11.40 1326 4.59 399 1926 
12.35 1323 4:44 418 1323 
11.69 1323 3-93 389 1323 
10.40 1284 3-71 3-37 1284 
11.46 1314 417 3.86 1914 
8.39 658 3-49 3-43 658 
793 595 343 299 595 
9.03 663 3-44 3.39 663 
8.22 637 3-17 3-23 637 
8.39 638 3.31 3.26 638 
6.14 1540 1.83 4.02 1540 
10.38 1566 5.30 3.76 1566 
5-19 1582 2.93 3-43 1582 
10.47 1543 .25 378 1543 
10.36 1558 309 3.72 1558 
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